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ABSTRACT 

The Demonstration Training Program (DTP) undertaken 
by the Detroit Medical Foundation (DHF) was designed for Primary Care 
Unit staffs (PCUs) or Physician Corpprations (PCs), area health 
center providers undef contract to the Michigan Health Maintenance 
Organization Plans, Inc. (MHMOP) • The major goals of • the program were 
to design an appropriate curriculum for the staff of PCU centers 
(physicians and other health professionals), develop training 
methodology for icjplement ing it, produce a training manual outlining 
the procedures for program implementation in other HMQs^ and increase 
PCU staff cohesiveness and levels of knowledge about. HHO systems. The 
report is divided into four major parts. Part 1 describes: MHMOP 
(with 28,000 enrollees and 19 health centers) the DMF, and the 
planning, implementation, and evaluation phases of the DTP. Part 2 is 
the individual Practice- Association model HMO Training Program Manual 
which was developed during the training process. Part 3 is a process 
and impact .evaluation of the entire project prepared by a 
sub-contractor to DMF which indicates that the basic project^ 
objectives were accomplished. Part 4 contains appended material 
iBCluding taajor supportive materials used to design and implement the 
DTP and a list of trainee participants. (Author/MS) 
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PREFACE 



. 'This final report of the Demonstration Training Program 'conducted by the Detroit Medical 
Fbundation between July 1974 and November'^ 1975 |nas been pr^P^^ed in fulfillment of the contract 
(Number l-MB-44196) awarded by the Division of Associated Health Professions, Bureau of Health 
Manpower, Health Resotnxes Administfation, Public fJ^alth Ser^sice of DHEW. The report has been 
designed to serve as a staf? training program guide for Health Maintenance Organizations in the 
United States. ■ ^ ' 

The training pro-am undertaken by the Detroit ^ Medical Foun^j^n was specifically a 
''Demonstration Training Program to Improve the Capacity of Primary Care Unit Staffs to Function 
Within an HMO^etting" By definition, primary care unit staffs are the area health center providers 
(Physician Corpor^ons or PCs; Primary Care Units or PCUs) under contract to the Michigan Health 
Maintenance Organization Plans, Inc. (MHMOP.) As a Health Maintenance Organization, MHMOP is 
a multiple group practice HMO, whose organizational design is based on the Individual Practice 
Association (IPA) model HMO. 

This report has been divided into four** major parts. Part I provides a description of MHMOP, thie 
HMO which served as a laboratory for the demonstration training program; a- description of t\fe 
Detroit Medical Foundation, which preceded and planned the existence of MHMOP; and an overview 
of the planning, implementation and evaluation phases of the Demonstration Training Program. 

Part . II is the '*IPA model HMO Training Program Manuarv which was used as a resource 
information tool and was developed during the training process. The implementation of procedures 
and methods developed for the demonstration and training program are also discussed. 

Part III is a process and impact evaluation of the entire project. It was prepared by Technical 
Assistance Research Programs, Inc. (TARP) as a sub-contractor to the Detroit Medical FouAdation, 
T/|RP is located in Washington D.C. Although the evaluation report was prepared as a sepaime 
document, some of the information appearing in Parts I and li is rep^^d in this part fp!r 
evaliiational purposes only. - / \ 

Part IV contains Appendix 1 through 9, the first eight of which include major supportive 
materials used to design and implement the Demonstration Training Program. Appendix 9 includes 
the list of trainee participants in this program. 

Many individuals contributed and participated in the Demonstration Training Program without 
whom the training program would not have been a success. We would like to take this opportunity to 
thank th^m all heartily. Their hope and ours is that this report and the training manual which it 
contains will become of service to other Health Maintenance Organizations. 

J.L.L. 
and 
^ C. L.M.J. 

. ' ^ November, 1975 
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PART I 



OVERVIEW OF THE DETROIT MEDICAL 
FOUNDATION DEMONSTRATION TRAINING PROGRAM 



BACKGROUND: MHMOP, INC. 



Michigan Health Maintenance Organization Plans, Inc. (MHMOP, Inc.) is a multiple group 
Individual Practice Association (IPA) model HMO, which was organized pursuant to PL 93-222, the 
federal HMO legislation. An IPA model HMO is an innovation in the structure of a solo practice, 
fee-for-service, delivery system. This IPA model of the HMO structure utilizes much of the medicaJ 
capital outlay already in existence within the health care delivery system. This organizational 
concept began in Detroit, Michigan in May, 1971 through the interests of a group of inner-city 
physicians and consumers who contributed $400.00 in seed money to establish the Detroit Medical 
Foundation (DMF), a 501(c) (3) non-profit corporation. As the IPA conceptual model HMO developed, 
DMF Bubsequently became the research and deveiopmeat compoinent of MHMOP, 

The MHMOP Delivery System 

MHMOP provides health services via contractual agreement with Physician Corporations (PCs) 
whose organizational design is based on the IPA model HMO. A^mejority of the physicians in these 
primary care units (PCUs) are members of DMF. These corporate PCUs assume total responsibility 
for»the delivery of primary healtlt' services to individuals enrolled for them by MHMOP. Costs of 
hospitalization, transportation, prescription drugs, and other supportive services are paid for by 
MHMOP. Presently, there are 19 primary health care centers located strategic areas of Detroit and 
its surroun(iing suburbs that have a contractual provider relationship with MHMOP. 

This network of PCU health centers facilitates optimum convenience and accessibility for 
"^HMOrP enrollees. There are numerous advantages to this mechanism. First, for example, JVIedicaid 
eligible persons who voluntarily choose the option to receive health services from MHMOP may elect 
to receive these services at any one of the 19 health centers. (Out-of-area medically necessary 
emergencies are also covered in MHMOPs benefit package.) Secondly, since many of the PC provider 
groupfs have previously been the primary providers of medical services in their geographical areas, 
only minimal interruption in the continuity of care for MHMOP enrollees has been necessary. In fact, 
the creatiori 0f MHMOP with its affiliated PCU centers has optimized continuity of care by providing a 
mechanism for total G^nd comprehensive health care services to a medicaid,' population. Through the use 
of the existing health delivery structure and manpower resources, MHMOP has been successful in 
developing a delivery system which, at the outset, required minimal expenses for facilities and capital 
investment. * ^ 

^ When enrollees voluntarily elect to receive all of their health services from MHMOP and their 
eligibility is subsequently approved by the Michigan Department of Social Services, they are given a 
''membership kit". This kit contains a .listing of the locations and names of all MHMOP health 
centerSw4v list of the physicians who staff these centers, the nam^ of participating hdspitals^ where 
the enroTlee may receive supportive services, and other general informatjpn on how to use MHMOP> 
comprehensive health care plan. 

The enrollee may also exchange his Medicaid card for a plastic embossed MHMOP membership card. 
Since, at the present time, MHMOP does not ftfTer dental services, the Medicaid enrollee subsequently 
receives a "Dental ynly" Medicaid card from the Michigan Department of Social Services. However, 
as a special service to these consumers, MHMOP maintains la list of dental physicians- who have 
indicat^ a willingness to serve Medicaid eligible recipients. This list is made available to MHMOP 
eni'oll^es upon request. - , .- ♦ 

As of September, 1975, MHMOP has 28,000 enrollees. It is Michigan's only multiple V^oup 
practice IPA model HMO. It is also the only DHEW funded development grantee in Michigan as of 
September 30, 1975. , . * 
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BACKGROUND: DMF DEMONSTRATION TRAININ^; PROGRAM . ' \ 

Idemtifacatiom Of The Need For Traimng Programs In HMOs 

Since the inau^ration of the HMO setting, the HMO has represented a major change in the 
health care delivery system. It entails a change or transition from a fragmented system of health carets 
delivery tojan integrated one. This change challenges established patterns of attitudes, behavior, and 
knowledge of traditionally oriented and trained health manpower. Physicians accustomed to a highly 
individualized stifle of medical practice find themselves part of a team of health care providers 
composed of not only other physicians, but also a variety of allied health professionals. The allied 
health professionals, who are oHen long accustomed to being isolated from the mainstream of medical 
practice, find themselves in a professional setting that offers both the opportunity and challenge to 
influence and be influenced by physicians. Both physicians and allied health 'professionals are jointly 
affected by the apparent com^>le:rities of the operational aspects of an HMO program. Hence, the 
change challenges professional values and norms governing the way health manpower view each 
other and hovy they perceive their patient^. 

Since a change from the traditional way of doing something can present a threat to anyone, it 
often results in resistance. Resistance to change may be even greater when the person involved is not 
fully i^nformed or fails to compreh^d completely the meaning of the change. Thus, careful training of 
all professionals and paraprofessioWals involved becomes mandatory. However, the vehicle of training 
can facilitate planned change froniNhe fragmented system of health care delivery into ah HMO 
setting only if it is designed to make rrapact on the information or knowledge base of the trainees. 
When this impact is made, attitude changes will occur which should lead to a decrease in the 
resistance to the planned change. ^ . 

HMOs that are in the developing stages have problems similar to those in other developing 
organ izatijons. For example,- there is an immediate problem of lack of 'communication and interaction 
among staff which creates additional, unnecessary problem^, anyone of which might be crucial to the 
growth and development of the organization. In case of PCU center staffs, they may be completely 
unaware of current administrative policy because it may change drastically, within a short time span, 
or^it may fail to filter out quickly enough to the PCU center staffs. The vehicle of training can be 
used to facilitate communication and interaction among staff by creating an opportunity for staff to 
interact with one another and to share jointly Communication problems and others commonly 
encountered in the HMO setting. When training in an HMO setting facilitates communication flow 
and interaction among staff, it also contributes to biiilding a sound organizational structure. 

* 

Need For Trammg m MHMOP^ 

The need for training in MHM0P has been no different than the need for training in HMOs 
'generally. However since the HMO process is new to the PCUs who have agreed to perform withm 
MHMOPs IPA model HMO setting, additional special guidance and technical assistance has been 
required in the transitional phase. For the PCUs, the transition from the traditional fee-for-service 
environment in which they were working prior to their affiliation with MHMOP requires a special 
sensitizing and socialization. Thus, the DTP was viewed by DMF and MHMOPs central 
administration primarily as a vehicle^ for facilitating this socialization • process to ' improve 
communication with, and interaction between>MHMOPs central office staff and the PCU center staffs. 

About the time DMF re^lizejl the need for training in MHMOP, it also became aware of available 
health manpower development funds from the office of Special Programs, Bureau of Health 
Manpower, DHEW. Since these funds were earmarked for health manpower development in HMOs 
and other prepaid group practice settings, the DMF nioved ahead to submit its proposal for a 
demonstration training program. 

» 

, Proposal Writing AnA Award, Of ^Domtract 

In the initial preparation of the proposal for DHEW funds, it was recognized that there was a 
conflict between the health manpower development goals of the federal government and the 
particular MHMOP training goals of DMF. The federal government was making funds available for a 
^ demonstration training program which would serve as a guide for other HMOs. The DMF, however. 



*f'{>r morf detail. H<»e Part III, the Evaluation Report/J^ctjon III B 
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wanted to conduct a training program which would*^meet the specific training ^needs of MHMOP and 
its member PCUs. Therefore, the goals which v/ere written into the proposal had to be'deaigned to 
meet the needs of the federal government a*s well as those of DMF. 

The final DMF proposal accepted and a contract, awarded in July, 1974. The four major goals 
of the Demonstration Training Program iUTF), established in this contract were as follows: 

1. Desi^ an appropriate curriculum for the staff of PCU centers. 

2. Develop training methodology approp^te to the implementation of the curriculum. 

3. Produce a training manual outlining the procedures that should be followed by other HMOs 
wishing to implement fiuch a program-. : ^ ' 

The contract also required that the DTP seek to produce two specific effects as a resist of its 
efforts. First, the program was to seek to ii^prove the levels of information and knowledge ab^ut 
HMO systems among the PCU staffs participating -in the training effort. The 'areas specified" were 
health care administration, finance, operations, management^nforniation systems, and marketing. 
Secondly, the program was to seek to increase PCU staff cohesiveness. In order for DgftF to 
implement the contract, the federal government also required that thie following be accomplished: 

1. Review the State-of-the-Art of training programs conducted in other health care 
organizations. • 

2. Specify the curriculum content to be used by DMF. ^ , 

3. Specify the training methodologies appropriate to implement each segment of the 
curriculum. ^ ^ 

4. Specify the instructional m<^dia for conducting training. 

5. Develop the training curriculum materials. 

6. Develop the evaluation design. 

7. Select the primary care units or IPAs for training as control and e^erj^^pntal groups. 

8. Sel^t a consumer panel. » ^ - 

9. Determine the logistical arrangements. 
10. Establish two training sessions. ' 
H. Prepare an evaluation of the DTP. 

12. Produce the required material fon the federal government. 

Once these 12 charges were further clarified by the federaTgovemment, the DMF project staff 
commenced the DTP. 
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DTP PLANNING PHASE 

During the pre-planning stages of the DTP, it was decided that it was necessary to obtain HMO 
training needs data on the participating PCUs. MHMOFs management information system collected 
these data .on all PCU center staffs affiliateicl with MHMOP, and the appropriate data were made 
available to the DMF"team. These data ^}^eTe gathered via' two instruments: the special needs 
assessment and the baseline information protocol* The' needs assessment instrument determined the 
perceived HMO training needs oV. the PCU stafin. The h^eime information protocol determined the 
knowledge base ^'ajnong the PCU staffs about HMOs^ and specifically MH^PP. These data were 
important because the special needs assessment did not necessarily reveal completely the level of 
information an^J an- understanding of the PCU staffs. The analysis of both these sets of data 
facilitated the task of specifying the training curriculum content areas for the DTP. 

After the perceived HMO training needs of the PCU staffs.were assessed, MHMOFs central office 
administrative staff was consulted on their perceptions of what the PCU staffs needed to know about 
IPA model ^MOs, and specifically about MHMOP. These data were utilized along with those from 
the other instruments to develop the training curriculum. In addition, a consuiper panel was selected 
to work as a body of consumer consultants on the training curriculum. The panel ^ was composed of 
consumers who ar^ enrolled members of MHMOP apd were therefore patients ;atahe PCU centers 
affiliated with MHMOP. The consumer panelists were asked to express their perceptions of what 
information ;the PCU staffs .needed to have in order to communicate satisfactorily with patients and 
their families a^out MHMOP. . , o * 

Ooce th^-data ha,d been collected from these three interested groups the value of the needs 
as^sessment of the PCU staffs became even clearer. It made it possible to reduce any potential conflict 
between their' perceived neec}s and those expressed by the consumer panel and MHMOFs central 
office administrative staff. The DMF project staff had the task of resolving any resulting conflicts. 

The needs -assessment and the baseline' information protocol data on the PCU staffs were 
analyzed wiih the help of a curriculum cofisultant, anj^ curriculum objectives were stated. From 
these, a curriculum flow chart was deigned tQ outline each segment of the training curriculum and 
the ty/o training sessions that were agreed to in the contract. A curriculum training staff to be 
responsible fpr specific segments of the curriculum content was then selected. It was composed of 
members of MHMOFs central office staff only, in the belief that PCU staff trainees would be more 
receptive to, them than to outside trainers. Furthermore, it was believed that the use of outside 
trainers would not create as great an opportunity for communication and interaction between PCU 
staffs and central office staff. / 

After the curriculum training staff was identified, the development of specific training 
methodologies appropriate to implement each segment of the curriculum was initiated. This consisted 
of the selection of effective instructional methods (e.g., lecture, seminar, group discussion, etc.) and 
instructional materials for dissemiijating th6 curriculum content area detail to the trainees. 

The instructional media, included a role play slide film of four major activities which occur 
between the consumers enrolled as members of MHMOP and the central office staff of MHMOP. The 
slide film also included commonly held concerns about the PCU staffs and the MHMOP organization. 
The instructional media additionally consisted of other slides developed and used by the curriculum 
training staff during their presentations. An information manual was designed for the trainees and 
was included in an information packet at registration.** \ 

As required by the contract awarded to DMF, a review of the "State-of-the-Art" was conduct/ed.'^** 
This activity was subcontracted to the Technical Assitance Research Programs, Inc. (TARP). A review 
of the literature on training programs in health care organizations was conducted to provide the DMF 
training project staff with models or examples of various types of training activities which had been 
conducted in other health care organizations. Unfortunately, the literature review did not prove to be 
very useful because very little has been written on training programs conducted in health care 
facilities which was directly applicable to the HMO setting. 

Criteria for the selection of the PCU centers which would participate in the DTP were developed 
simultaneously with the curriculum. Due to budgetary and logistical constraints, it was not possible 
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"to. include all 19 PCUs affiliated with MHMQP. Only eight of the PCU centers were inclyded'in 
the DTR SiK of >thfe/eight actjially participate (n fhe^ DTF (the experimenta} ^oup), |uid the 
remairting two (the controj g^oup)*did not, so a comparison of change jn -knowledge base and attitude 
could be conducted af^er the training sessions^ The P^U center selection criteria consisted of the • 
following:^ . ' ; / ^ ' 5,^,^ , / , ' » 

^ Maturity of the PCU eenter., / ! ' ' . 

— Williijigness 6fPCU staff t(S^'cooperate in the project. ' ^ ^ 

— Size of PCU staff. ^ / • ' , _ - . - 

— Size if ?CU enrollment. / ' ' \ . ' ' 

— Lack of PCU' staff conflict. ^ ' * \ 

' Once the participating PCUs were selected, k)gistical arraftgements were initiated for the DTP. 
At the beginning of the- DTP, .consistent with^the contract requirements which indicated there should 
be two training sessions, it was decided that there would be an tiut-of-town w,^kead sessiop and an 
in-town follow-up session. Meals, transportation, and hotel rooms were provided'for the trainees for 
^the out-of-town weekend session, and arrangements were made during both session^ for coverage of 
emergent patient care fteeds of enrollees assigned to the participating PCU centerf. * 

Prior to the implementation of the out-of-town weekend ge8sion,\the curriculum training staff 
was requested tp prepare and submit a draft of their presentatioiv to the DMF staff for review and 
comment. Accordingly, the presentations were ^amended for a dress rehearsal held one week before the 
out-of-town wecrkend training session. This gave the DMF staff an<j[*the cfurriculum consultant the 
opportunity to assess the presentation delivery stj^le of th^ training staff and make helpful comments.^ 
Some of the curriculum training staff members played the Yole of group leaders for small group 
discussions. Prior to the first training session, theise training staff members wef*e informed of the role' 
they were to play as facilitators of^mall group discussions, focusing on specific topics. ' 
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DTP IMPLEMENTATION PHASE 



T(v implement the DTP, means had to be idehtified to stimulate the inter^t of the trainees to 
participate in the program. Arousing interest required a-great deal of time and effort. Direct personal 
con&Lct was made vvith e^ch of the participating PCU cehtefs by both DMF stafT and individuals of 
MHMOP^a staff to explain the purpose of the DTP and the benefits one would derive by attending the 
trainiW and follpw-up training sessions. Constant reminders of the training sessions, such as 
telephcme calte^letters, flyers, etc., were sent to the participating PCU staffs to arouse their Interest 
and t(^elp^sure their attendance. The selection of a convenient timfe and place for the two sessions 
aided considerably. * - / *^ ^ 

B^^r to the conririencement of the" training session^, various onsite arrangements were made. 
esfQ arrangements included coordination of registration , and all registration materials, coordination 
)0f the insfiructional media, and provision of an emergency telephone for the physicians in attendance 
and a measage board. ' _ ' ' ^ 

A decision was made jt9 have an oi^site conference coordinator who would be responsible 
primarily for facilitating th^ process of adhering to the training agenda time schedule. In addition, 
the conference coordiitator oriented the curriculum training staff to the meeting facilities. 
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DTP EVALUATION PHASE 



The DTP was evaluated from the two standpoints of process and impact. To avoid contamination 
and bias in the evaluation of the DTP, the responsibility for the evaluation phase was subcontracted 
to TARP, the independent corporation which had already |ione the "State-of-the-Art Review." The 
evaluation report prepared by TARP does not necessarily reflect the opinion of the DMF staff in all 
project co'mpon^pts evaluated. ' ' 

The "process evaluation consisted of a detailed narrative documentation of all aspects of the 
origins, planning, and implementation of the DTP. It also consisted of a critical review of these 
aspects which highlighted significant problems encountered by the DMF team, how they were 
resolved, ,and what their implications might be for the planning and development of training 
programs by other HMOs. In this process evaluation,, however, process by which the curriculum had 
been developed was not included. 

To implement the impact evaluation, a classical experimental research design, a control group of 
PCU centers had been selected during the planning phise. Thus, a comparison of the "before and 
after" statuses of participatory and non-participatory center staffs was possible. The comparison was 
thought to provide the evaluators with a measurement of impact or change. The data used were 
gathered by MHMOFs management information system and mad^^^p^vailable to DMF for an analysis 
to be conducted by TARP. In addition, data were also collected by MHMOFs management 
information system for evaluation by TARP on how well the experimental group liked the format of 
the out-of-town weekend training session.** 

After the evaluation was well underway, the DMF staff and TARP agreed that it was not 
necessary to have selected an experimental and control group of PCU centers. A "before and after" 
assessment of Jcnowledge and attitude change would have been sufficient. Selecting a control and 
experimental group of PCU ceYiters was not effective because many of the PCU centers shared staffs * 
which made it difficult to invite certain staff of a center to attend the training sessions without 
inviting the others. Those PCU centerb'^hicJbi .were identified as control groups, but did not share 
staffs with an experimental PCU center, still heard about the training sessions and assumed they 
were invited to attend. When they found out they were not, they had problems understanding why. 
Since the most important task of the DTP was to train as many PCU center personnel as possible, the 
DmF might have been better advised to include more staff in the training session. 




/ 
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*For more dctaiUse« Appendix 5 T^valuation Design" and Part HI, the Evaluation Report/ 
** For tejit of "Your Opinion Pleas* Questionnaire," 8«e Ap|:«njdix 6 
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SUMMARY: DTP CONCLUSIONS AND RECOMMENDATIONS 



The DTP conducted by DMF can ber viewed as a success in that both the informational and 
socialization aspects of the project were addressed successfully as has been documented in the 
evaluation report. A positive change in attitude on the part of the staff in the experimental group of 
PCU centers toward MHMOP took place.- This change was determined thtough the administration of 
the fiS2^-up baseline information protocol questionnaire and through observations by DMF staff. A 
two-^^y channel of communication between these PCU centers and MHMOPs central office was 
initiated as a result of the DTP. 

The DME team learned a great deal about the process of planning and implementing a tra'i^ng 
program in an HMO setting. They have attempted to document this process, in Part H, Manual For 
Conducting An HMO Training Program. TheNDMF team learned that the training design selected to 
conduct a training program should only be presented if it can be operationalized in the setting being 
used for the training ground. It is not recommended that participants be selected and divided into 
control and experimental groups merely because it ife thought that a control group will make the task 
of conducting an evaluation easier. To the contrary, only one group of participants given a simple pre 
and post training assessment for changes in kirpwl^d^e base and attitude should prove to be 
sufficient. If a control and experimental gi^oup are selected from the same HMO setting, it is likely 
that they will not remain as separate entities throughout the training effort. 

Conducting some form of a needs assessment with the potential trainees is highly recommended 
for several reasons. The first and foremost is that and certainly not sufficient, to define their training 
needs for them. Secondly, by conducting a needs assessment with the trainees, they will know that 
some of their ideas have been included in the decision making process for the training effort. In the 
process, curriculum designers rpay address some of their expressed needs. A needs assessment with 
the trainees can also serve as a means of opening up communication and stimulating curiosity which 
helps to set the stage for the training session. 

The' utility of a literature review, which summarizes documented data on training programs 
conducted inij^settings similar to an HMO, proved to be- marginal. There is very little documentation 
in the literature on this subject and perhaps a wider search should be made. However, the cdst of 
conducting a wider search may be much greater than the benefits gained. 

Training should be an ongoing activity within an organization if a significant and lasting* impact 
or change is desired via the vehicle of training. Training that is conducted as a "one shot" activity 
has marginal results and is not likely to result in change in behavior because reinforcement is 
lacking. This DTP effort was not designed to address change in behavior directly, but to initiate 
socialization in the HMO« setting and to present needed information to participating PCU staffs. 
Changes in the behavior of staff which will lead to more effective and efficient delivery of health care 
servites should be the ultimate goal of health manpower development training programs. ^ 

Training, should create and/or reinforce two-way flow of communication between the central office 
staff of an HMO and its PCU center staffs. An established and accepted means of communication will" 
better ensure that dissemination and retention of information takes place. It will also open up 
channels for feedback from the PCU center staffs to the HMO central office staff and vice versa,. so 
that both groups can keep apprised of one an^i^Jier^s perceived bottlenecks in the HMO system. There 
is limited utility in the use of lectures as the primary instructional method for the training effort if 
the lectures do not allow for two-way flow of communication and informal interaction. Both two-way 
flow of communication and informal interaction should be created and reinforced ihrou^hout the 
training effort. 

Finally, if the training effort is to be successful, « strong commitment must be made to Uiq effort. 
A strong commitment to the training effort includes not only the employment of a full tmie staff 
personnel, but participation on the part of the PCU center staffs and the administrative staff of the 
HMO in the design of the ti:ajning effort. If a strong commitment is not made to the training effort, 
the benefits are likely to be marginal and the costs will be high. 
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INTRODUCTION 

purpose of this manual is to provide Individual Practice AESociation (IPA)'^mcdel Health 
Maintenance Organizations (HMOs) with a training program tiesign which may be developed to facilita)^ 
the transition of medical, para-medical and other health professionals into an IPA model HMO setting. 

Xhe training program methods and procedures suggest^ are the result of the eicperiences of the staff 
of the Detroit Medical Found|tion (DMF) in the implementation of DHEW Contract No. l-MB-44196. 

The 'contract title ""Demonstration Training Program to Improve the Capacity of Primary Care^Unit 
Staffs to Function within an HMO Setting"' (DTP) was awarded to the DMF in July of 1974. The 
contractee was the Division of AssQ5:iated Health Professions, Bureau of 'Health Manpower, ^blic Health 
Service of the Department of-Health, Education and Welfare (DH5JW). 

". . . Primary Care Unit Staffs . . (PCU) referred to in the contract title^ sre'the staffs of the contract 
health services^ provider groups of Michigan Health Maintenance Organizations Plems, Inc.*(MHMOP), the 
only DHEW fund^ HMO development grantee in Michigan. MHMOP is an IPA model HMO. 

A graphic flow"* chart presentation of the training program design is shown on pages Il-ii-iii. This 
manual describes in detail the four phases of the DTP approach outlined in tfie flow charf^' Thi^ manual 
also represents part 11 of a final report prepared by the DMF in compliance with the DHEW contract. 
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PRE-PLANNING PHASE 



I 



Identification of the Need to 
Conduct a Training Program 
in un HMO Setting 



" identification of Training 
Pr(*t<ram*H T^ryel Population, 
If I PA Physicians vf. Allied 
Health Pernonnel vs Both Groups 



I 



iHpntification of Trailing Program 
(joal» /ind Formulation 
of Training; Objectives 



V 



Need Assessment of 
Perceived Training Needs 
among Potential HMO Trainees 



Aosesoment of Knovvl^ge Bace 
Concerning HMO's Among 
Potential Trainees 




Data Analysis 



Data Analysis 



PLANNING PHASE 



I 



Development of Trainm^ 
Curriculum Objectivei* 





Review^ the 


Data Analysis 


a 


State-of-the Art 











I 



^ Specification of* Topic Areas 
and Content of the Training 
Curriculum and Development 
of a'Flow Charto' 



I 



Selection of Appropriate 
Training Methodologies 



I 



Selection of ^ 
Instructional Aids 



I 



Selection of Curriculum 
Training Staff 



I 



Development of Training 
Session Agenda 
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PRE-IMPt.KMENTAtl()N PHASE 




Training of the (*urnculum 
Trammg Staff 



Development of Curriculum Topic 
and Content Outlines for 
(.'uri;iculum Traininf^ Staff 



Development of Written Presentation 
DraftM by ('^o^iculum Truininf^ Stafl' 



Review and Comment by Training 
Program Coordinators 



Revision of Written 
Presentations 



Dress Rehearsal 



Development of Ijjstructional Aids 



lx>gistical Arrangements 

• Meeting Facilities 

• Audio/ visual Equipment 

• Housing 

• Meals 

• Transportation 



Motivating IPA Staffs to 
Attend an HMOs Training 
Program 



IMPLEMENTATION PHASE 



I 



Coordination of Registration 
Materials; 

• Name Tags 

• Agendas 

• Handouts 

• Manuals 



Coordination of Onsite Training 
Session Activities 



I-mplementation of 
Training Sessions 
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Identification i>^j£he Need to 
Conduct a ll^i^tn^ Program 
in an HMS^etting 



I 



Identification of Training 
Program's Target Population, 
i.e., IPA Physicians vs. Allied 
Health Personnel vs. Both Groups 
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Identification of Training Program 
Goals and Foi'mulajion 
of Training Objectives 



Ne^d Assessment of 
Perceived Training Needs 
among Potential HMO Traineei§ 



Data Analysis 



Assessment of Knowledge Base 
Concerning HMO*s Among 
Potential Trainees 



Data Analysis • 





Review of the 


Data Analysis 






State-of-the Ar^ 
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SECTION i: PRE-PLANNING PHASE ^ ^ 

The need for health manpower training in an HMO should be identified.during the initial stages 
^ of the organizatioix'5 development. Early identification allows the maximum benefits of training to 
occur. Once ^ke need for training is identified, broad objectives of the training effort should be 
formulated and serve as a basis for de^loping the training program. 

Just as important to the" training effort is the presence of a full-time training program director. 
' This director should, possess' the appropriate academic credentials and capability to work with both 
physicians, and allied health personnel. It is this writer's opinion that the training effort may 
/ generate more active support of the physicians affiliated with the HMO if the training program 

director is perceived as, or in actuality is, subordinate to a physician at the administrative level of 
v the HMO. After an appropriate training staff director has been identified and reporting paths 
established, the regular activities of tHe pre-planning phase can begin. 



Identification of the target populations 

It is important that the target population be identified and defined during the pre-planning 
phase. This facilitates the collection of relevant data for use in the cun*icultim design. The target 
population of an IPA model HMO training program may consist of the HMO's contract PCU 
physicians only; its allied health personnel only; or a combination of both allied health personnel and 
PCU physicians. Based upon the objectives of the training, program thYe^e basic types ,of data should 
be collected and analyzed before the training curriculum objectives can be formulated. The three 
types of basic data are: . ^ 

1. Needs Assessment - . . 

2. Baseline Information Protocol 

3. Review of the State-of-the-Art 
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NEEDS ASSESSMENT OF POTENTIAL TRAINEES 

Before an HMO training program curriculum can be effectively designed to meet the needs of 
potential trainees, their needs must be assessed. An attempt should be made to gather training needs 
data regardless of potential trainee*s prior exposure to the HMO concept. 

A needs assessment is conducted with potential trainees allowing them .to express freely their 
perceived training needs. This'process is meaningful only if confidentiality of the trainee's response is 
assured. * ^ 

The recommended design of the needs assessment to be conducted with potential trainees is the 
following: ^ . " , B 

' II-2 ^ 



STEPS 

1. Self introductions of 
' ' all present. 



2. Explanation of the 
needs assessment acti- 
vity to the group. 



3, Adinnpdstration of the 

SpecidJ N^eds Assess- 
ment Form.* 



4. Individual reporting 
of comments made on 
the special form. 



5. Group discussion of the 
comnoents. 



PURPOSE 

1. Provides an opportunity 
for each group member 

to become acquainted with 
all present. 

2. Provides legitimacy to 
the activity; helps thpse 
participating to under- 
stand the activity; con- 

' tributes to participant 
cooperation. 

3. Helps focus the atten- 
tion of the group mem- 
bers on their perceived 
HMO training needs, thus 
saving time. Provides ^ 
written documentation 

of individual needs of 
' group. 

4. Provides group members 
an opportunity to parti- 
cipate in the group dis- 

■\/ cussion revolving around 
the individual training 
needs of group. 

5. Provides group members 
an opportunity to express 
opinions or seek clarifi- 
cation on comments made 
by other group members 
and r^uest additional 
information. 

6. Provides training team 
with the group*s asses- 
ment of its training 
needs in order of 
priority. . 



MATERIALS 
NEEDED 



3. "Special 
Needs 
Assessment 
Form." 



4. Resource 
to record 
answer. 



6. Resource 
to record 
answei*. 
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6. Group establishes an 
order of importance 
for corhments; thus 
sets priorities for 
graining. 

recommended needs assessment design, commonly referred to as the "round robin" method, 
facilitates the task of getting all group members involved in the discussion. The DTP design begins 
with steps 1 and 2 of the recommended design. This is followed by the distribution to group 
participants of the special needs assessment form. (Step 3.) Participants are asked to record their 
responses on the form and at the same time assured that their comments will be discusse4 without 
identifying their origin. After the forms are filled out, the discussion process is initiated by the 
project administrator. This process begins by soliciting a volunteer or randomly selecting a group 
participant to make the first comment. Each participant is given the opportunity to provide 
additional comments. The comments made by individual group members are recorded in a manner 
which allows visibility and review by the entire group, i.e., blackboard, easel, etc. As the discussion 
progresses, the project administrator tabulates similarity of comments, recording the number of group 
participants who indicated similar comments on their special needs assessment form. This tabulation 
can be used to identify the number of participants having a particular training need. 

The project administrators monitoring activity may also be accomplished by a request that each 
group member record on index cards their perceived training needs. The tabulation method and/or the 
index card recording method will result 'in specificity of training needs. 

29 



•"Special Needs AGseaoment Form," see Eiihibit 1. 
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OTHER NEEDS ASSESSMENT CONSIDERATIONS \ 

Consideration should be given to "when" and "how" the needs assessment is conclucted. This is 
important in an IPA model HMO setting because the needs assessment group sessions may conflict 
with scheduled clinic operating hours. On the other hand, if the sessions are not scheduled during 
normal clinic operating hours, the sessions will probably not be well attended. 

How, the sessions are conducted is itftportant as well. For example, the presence of both allied 
health personnel and staff physicians in the same needs assessment session may inhibit free and open 
discussion by both groups. / 

A ^femprehensive needs assessment should address the perceptions of both the HMQ 
administrative staff and the HMO enrollees. Knowledge of the administrative staffs perceptions of 
the affiliated PCtTs training ,needs, as well as the enrollees' view of the HMO*s services represents 
invaluable input during the n^ds assessment process. The enrollees* input may best be garnered by 
^the use of a consumer p^el comprised of a random' selection of HMO enrollees. 

SUMMARY 

In summary, it is recommended a needs assessment activity address the perceptions of potential 
trainees, HMO administrative staff and HMO consumers. This approach reduces the probability of 
inadequacies in the training program curriculum design.^ftVhile analysis of needs assessment data 
may reveal conflict between the three groups, the identification and resolution of this conflict prior to 
the implementation of the training program is critical to the development of an effective training 
program. ^ 
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Baseline Information Protocol *' ' 

^ - V 

The "baseline infonnation protocol" was.tn^econd assessment tool UEed.'lte purpose was to identify 
the kno^vledge level of potential trains relative to HMOa This data collection instrument affords the 
identification of content areas which should, or should not, be emphasized. A variety of methods may be 
used to identify these ODntent areas: ^ 

1. Assessment of questions commonly asked of the HMO's administrative staff by the HMO PCU 
staff. 

2: Determination of areas of conflict relative to information exchange, 

3. Evaluation ^of reporting mechanisms between the HM(? administrative offices and the PCUs. 
A questionnaire may i^e used to collect this data from potential trainees. 

Scheduling problems and assuranf^s of confidentiality for respondents are also pertinent to the 
administration of the information protocol. Prior to the administration of the information- protocol, 
questionnaire respondents should be advised of its purpose, the confidential manner in which their 
responses will be tabulate and assured that they are not taking a "test," The questionnaire design must 
also acknowledge the awareness level of its anticipated respondents. 

Planned group discussions may be u^d as an alternative to a written instrument. The discussion 
content should focus on t!he same issues addressed in the written instrument. Responses are recorded 
by the discussion l^der. ' 



Review of the State-of-the-Art* 

Ideally, a review of the current available health manpower training literature would provide 
guidelines in the design of a training program for the IPA model HMO. To provide maximum benefit, 
the review should be initiated and completed prior to the.planning of the training program. However, 
we found limited published material pertinent to HMO manpower training, since the HMO concept is 
relatively new. 

It is our expectation however, that this manual will be a meaningful addition to the literature as 
a guide far those attempting to conduct an HMO health manjjower training program in an IPA model 
HfMO setting. 
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PLANNING PHASE 



I 



Development of Training 
Curriculum Objectives 



Specification of Topic Areas 
and Content of the Training 
Curriculum and Development 
of a Flow Chart 




Selection of Appropriate 
Training Methodologies 





SECTION II: PLANNING PHASE 

.1 ■ 

Foraiulating Training Curriculum Obje<^tives 

A training program curriculum can be developed once the follov/ing data have been collected and 
analyzed: 

1. Needs Assessment conducted with an HMO*s 

a. potential trainees , 

b. administrative staff ^ 

c. consumer representatives. 

2. Baseline Information Protocol conducted with an HMO's potential trainees. s 

3. Review of the State-of-the-Art. ^ — >^ 

Training curriculum objectives should be based on the objectives of the training program, as well 
as the data bases wh^ch are collected via the needs assessment and baseline information protocol. . 
Formulation of the training curriculum objectives may be directed towards: (1) increasing levels of 

knov/ledge, and/or (2) changing attitude^ and/or (3) changing behavior. 

ft 

The following are samples of training curriculurayobjectives: 

1, To improve the levels of knowledge among PCU staffs about the differences between HMOs 

and traditional forms of health care delivery. 
•2. To improve the ability of PCU staffs ; to identify the major divisions and division 

responsibilities of the parent HMO. 
3. To improve the level of understanding of the HMO enroll^e benefits and rights. 

SpeciHcation of Training Curriculum Topics and Content 

The topics and content^of the the training curriculum are developed directly from the cujriculufti 
objectives. These objectives should determine the specific directions for the training. 

An illustration of possible topics and content for an HMO training ci^rriculum is presented below 
As stated earlier, these should be based on the needs 'of the potential trainees, HMO administrative 
staff, and consumer representatives. (Curriculum content topic areas are the outline headings, 
content area detail are the specific elements addressed.) 

1. What is an HMO? 

A. Definition. ^ 

B. Description of how HMO© differ from other health plans. 

C. Types V)f HMOs. 

D. Patient Rights within an HMO setting. 

d 

2. How Michigan Health Maintenance Organization Plans, Inc« Operates 

A. Description of major departments and divisions of the HMO Plan their m^or 
areas of responsibility. vl 

B. Identification of department and divi^on heads of HMO central office.^ 

C. , Services provided to the HMO enrpUees. ^ * 
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1. Basic and supplemental health services covered by the UMO Plan, 

2. Special enroUee services, i.e., emergency services, grievance mechanism, etc. 

D. Enrollment process. 

E. iJnroUment orientation process. 

F. Financial Structure of the HMO Plan. . 

1. Capitation payments. 

2. Fee-for-service payment mechanism. 



3. Ris^-sharing. 

4. Hospital payment mechanism. 



Development of Training Curriculum Flow Chart 

A curriculum flow chart should be ^veloped and iniplemented to facilitate the organization of all ^ 
training program'^ components. Exhibit IV is em example of this type of chart. The curriculum flow 
chart defines and outlines all major components of the training- program and training curriculum 
which may include: 

Training program objeclives ^ , * 

Training curriculum objectives ^ 
Curriculum topic areas and content 
Training methodologies . . ^ 

Instructional aids 

Curriculum training staff ' ^ ' . 



• ■ 



Time schedule for training presentations and discussions. 



o 
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Selection of Training Methodologies ^ 

Once the curriculum , content topic areas and content area detail have been defined, the 
appropriate instructional metjiods for conveying -the content detail may be selected. The perceived 
training needs expressed by potential HMO trainee? are important to keep in mind when 
instructional methods are being selected. For instance, analysis of the needs assessment data may 
reveal the need for potentpil trainees to engage in two way communication with administrative staff 
of an HMO. In such a case, instructional methods selected for the training effp^t should not prohibit 
two way communication and, indeed, ^should enhance^it. ( 

There are several formats which may be used for training sessions. The following are, examples: ^ 



TYPE 

Lecture 



<3 Small Work Groups 



PURPOSE 

Provide information 



Solve hypothetical 
problems and/or 
discuss mutual 
problems 
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CHARACTERISTICS 

Primarily one-way flow 
of communication; cur- 
riculum training staff 
serves as the resource. 

High participation; 
opportunity to engage 
in face-to-face inter- 
action; trainees and 
curriculum training 
staff both serve as 
resources. 



TYPE 
Seminars 



PURPOSE 

K)ichange information 
<jr opinion 



Conference 



Provide a variety of^ 
training experiences 
over an- extended 
period of time 



CHARACTERISTICS 

High participation; 
experience sharing, 
face-to-face groups; 
trainees and curriculum 
trainiW staff are both 
resourdes; training 
staff selves as leaders 
and content experts. 

General sessions; some 
face-to-face "groups; 
curriculum training 
staff provides most 
resources. 



The exclusive use of lectures as the instructional method is not recommended. Retention of 
information disseminated through lectures will be greater if trainees are given an opportunity to 
discuss information which is addressed in the lectures. Communication is enhanced via participation 
in smali^roups and special 'seminars. 

Selection of Instructional Aids 

Instructional aids, both printed and audio visual, may be developed as supplements to .the 
training curriculum. Aids may include, b^ut are not limilted to, handouts, charts, slides, films, and 
manuals. While instructional aids can be effectively used to facilitate dissemination of information to 
trainees, it is important that they be well coordinated with the presentations for which they are 

designed. If audio visual aids are poorly selected, prepared, and integrated into a training program, 

. a 

they can be confusing and distracting for the audience. Conversely, a movie or slide film well selected 
to illustrate or address a portion of the training curriculum can add to the pacing and variety of a 
training session. If it is decided, instructional aides will be used for training, sufficient lead time 
should be allowed for their development. ^ ^ 

An HMO information manual similar to the manual prepared for this project may be prepared as 
a supplement to the training curriculum.'*' This type of educational tool may be very useful to the 
trainees as a continuing reference. If it's determined an HiyiO information manual will be used, the 
manual should cover the major topic -areas and content of the training curriculum. The manual 
should be indexed for easy reference. - , , 
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Curriculum Training Staff - ' * ^ 

Selection of a curriculum training staff should ocour afler the selection of appropriate training 
methodologies and instructional aids. Since the selection of competent trainers is crucial to the 
effectiveness of a training curriculum, the process by which they are chosen is important. Project staff 
must give careful thought to criteria for the selection of training staff. These criteria should include: 
(1) potential training staffs' competency in the trainings methodologies chosen for the training 
curriculum and (2) previous experiences as trainers or group leaders. Consideration might also have-* 
to be given to the ethnicity and sex of the trainers, r 



*Se8 Appendb 4, DMF Final Rsport, "MHMOP Information Manual" 
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The curriculum training staff may consist of either professional trainers or staff members of the 
ys central office. It is to be noted that one major disadvantage of using trainers who are not 
members of an HMO*s staff is that the trainees may not be receptive to a trainer perceived to have no 
formal work responsibilities in the HMO setting. Once the staff is selected, they should be thoroughly 
briefed on how to effectively play their specific roles as curriculum training staff members. 

Development of Training Session Agenda 

The agenda for the training session should be developed easily from the training curriculum flow 
chart already described. It should indicate the exact times and meeting rooms for all scheduled 
activities, including breaks and meals. 

If a decision has been made to train both PCU staff' physicians and allied health personnel, 
separate agendas may be necessary, at least for some sessions of the training program. If two 
separate agendas av^ designed, color coding is recommended for efficient management of the trainees. 
It will be easier for each group of trainees to determine where their specific group is supposed to be at 
any given time.* 

A variety of activities may be included as T)art of a training session. Consideration shoulc^be 
given to scheduling an informal *Mcebreaker" as a kickoff to a training session. This type of 
'•'nonstructured gathering gives the trainees, curriculum training staff, and other attendees an 
opportunity , to interact socially with one another before the ^commencement of formal training 
activities. . ■ / - 



\ 
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*DMF training Essaion agenda, csa Exhibit V. 
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PRE-lMPLEMENTATION PHASE 
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Training of the Currjculum 
Training St'ajfT 



Development of Curriculum Topic 
.and Content Outlines for 
Curriculum Training Staff 



.Development of Written Presentation 
Drafts by Curriculum Training Staff 



Review and Comment by Training 
Program Coordinators 



Revision of Written 
Presentations 



Dress Rehearsal 




Development of Instructional Aids 



Logistical Arrangements: 

• Meeting Facilities 

• Audio/visual Equipment 

• Housing 

• Meals , 

• Transportation 



Motivating IPA Staffs to 
Attend an HMO's Training 

Program S 



IM2 
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SECTION III: PRE-IMPLEMENTATION PHASE 

^ . • I' 
Training a Curriculum Training Staff 

A curriculum training stafT should be informed, in writing, of the specific content and topics for 
which they are responsible. To faoilitate this task, it is suggested that topical outlines be prepared for 
each person on the training staff.^ The outline should include an indication of the training 
methodology to be used as well as an indicatioxy^the amount of time allotted for each topical area. 

The curriculum training staff 'should be asked to submit drafts of their lectures, discusston 
questions, and other presentations fot - review^ and coniment by the coordinators of the training 
program. Since the qitelity of these presentations is imp'qrtant to^he success of the training program, 
the drafts should be critically reviewed returned to the training staff for revisions and polishing. 

A dress rehearsal should be scheduled prior £o a training session. All lectures and presentations 



should be delivered by the curri'cqlum training staff. /An assessment of the effectiveness of each 
person's delivery- style should be made bypprojejst--staff.sitrhe assessment should result in suggestions 
for helpful changes in the oral presentation-. 

The curriculum training staff responsibly for leading special seminars and work^l^ops should be 

^ i ■ " ' " '. ' . 

well informed of the roles they aW to play. Consideration should be given to having a briefing 

session, specifically for those responsible for leading seminars and workshops. The content of this 

training sftsion should focus on leadership styles which encourage participation and facilitate groi^p 

discussion. , . " ^^L^ 

- W . 

Development of Instructional Aids • - : ^ • , ^ 

While instructional aids may greatly ,enhancG^the program curriculum their use must be planned 
consistent with the environment iji^which^ they are to be used, e.g., room size, visibility by 
participants, accoustics, etc. Althoygh instructional aids may appear to be easily produced, it should 
be ket)t in mind that effective ' aids require the expertise- of competent professionals. Such 
professionals require adequate lead time to prepare informative presentations. 

Logistical Arrangements , , " . ^ * 

The initial decision must be the location *of the training site concomitant with the relative merits 
of the accessibility of the training site for the program participants. While a conveniently accessible 
site may enhance physician participation, the proximity of the physician to his patient may lead t© 
his being called from the conferehce. Therefoi:e, consideration should ^be given to planning a^ 
out-of-town session to which all participants must mdke a special commitment. * • ^ 

The number of trainees should^ determined at the earliest possible date. Pre-y-egistration forms 
may be used for this purpose, in, the v event transportatioti; housing and meals are required, the 
appropriate arrangements must be made. "Relevant considerations in terms of selection sites are^ 
meeting room size and number; se^trngf^esthetics; and othet desired amenities of training program 
participants. , - 39 ^ 
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Size and number of training rooms and aiidio- visual requirements may be^^^ermined by agenda 
requirements. In the event an optimal training site is unavailable, the training agenda must be 
stFUCtured to fit the training site accomodations. ^ 

Motivating PCU Staffs to Attend an HMO Training Program 

An HMO training program should be legitimized in the eyes of its training program participants. 
One way to accomplish this task is to include identifiable program participants in the early planning 
phases of the project. The needs assessment study previously described is an example of this 
inclusion. 

Training program participants must have the impression that the training effort is a sincere, 
attempt to meet their needs. , - " u 

Following the initial announcement of the training program plans, contact should be made with 
all PCU staff expected to participate. This contact should consist of a statement of purpose for the 
training program and the benefits to be gained by attending. In addition, letters, telephone calls, 
flyers, etc., should be used as a means of continually reminding PCU staffs of the pending HMO 
training program. 

Son^ difficulty^ may be experienced because PCU staff physicians and allied health personnel 
provide health care services to fee-for-service patients as well as ,HMO patients. Consequently, 
attempts should be m^de to schedule training sessions in a time frame that will cause minimum - 
conflict with regular scheduled clinic hours. However, in the event that conflict-free scheduling is not 
possible, rescheduling of clinic hours by the program director should be investigated. 

Rescheduling of clinic hours may not occur without some form of peer ^oup persuasion. Peer 
' group persuasion may be initiated by physicians who are members of an HMO's administrative staff 
and who are also involved in conducting the trainmg program. 

A significant issue' of clinic rescheduling for PCU staff is potential loss of income ^^h .may 
result from an interruption of usual clinic hours. To compensate for potential loss^ of mcome, 
consideration should be given to paying PCU staffs a stipend for attending an HMO training 

program. • * " ^ 

Other incentives which may motivate PCU staffs to attend an HMO training program are: \^ 

• Inclusion of PCU staffs in planning of the training curriculum 

• Selection of a convenient meeting time 

• Selection of an attractive meeting place / 

• Selection of a well-known guest speaker ^ | 

• Provision of continuing education credits for participation in a training program \ 

A great deal of time and effort may be required to motivate potential trainees to attend the, 
training sessions. Hence, the training program must be effectively publicized to potential ^^ainees. 
Incentives for motivating a high level of .attendance must be well planned and implemented in 
advance of implementation of a training session. 

40 
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IMPLEMENTATION PHASE 















Coordination of Registration 






Materials: 




s 




h Ndttoe Tags . \ 






• Agendas 








• Handouts 








• Manuals 











Coordination of Onsite Training 
Session Activities 



I 



Implementation of 
Training Session^ 



s. 
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. ^ ^ SECTION IV: IMPLEMENTATION PHASE 

Coordination of Registration Materials 

Registration materials should be assembled prior to training sessions. An information packet 
m^y be prepared as a means of distributing name tags, training session agendas, handouts, manuals, 
and a\\ other materials which will be used during a training session. ^ All training materials prepared 
for trainees should be distributed at one time to avoid interruptions during tri^ining session activities. 

The handouts should be prenumbered before being inserted into an information packet. The 
numbers will malce it easy for curriculum training staff to refet to the handouts during their 
presentations. 

• , ■ ■■ 

Coordination of Onsite Training Session Activities 

A registration desk should be prepared and staffed throughout the training sessions in case there 
are late arrivals. A registration desk may also serve as an information booth. 

It is very important for physicians in attendance at a training session to be contacted iti the 
event a medical emergency arises with one of their patients. Arrangements should be made to provide 
a special emergency telephone for physicians. The emergency telephone arrangenjents should be 
made in advance, and an emergency telephone number announced to the physicians prior to a^ 
training session. A message board should also be placed at the registration desk in case an emergency 
call is made and a physician cannot be reached. 

The training session meetings should move smoothly and on a scheduled basis. To facilitate this, a 
specific individual should be designated as an onsite conference coordinator. This Coordinator must 
know the schedules of the curriculum training staff and the trainees during each phase of a training 
session. A second individual, a_ronference monitor, should also be responsible for keeping a training 
session moving according to a predesignated time schedule. For instance, in each meeting, the 
speaker shoulH be informed when his alloted time is drawing near so that he may begin to summarize 
his presentation»vThis canjj©- effectively handled by the monitor raising a color-coded card indicating 
^^5 minutes^^ "3 minutes", ^nd "time". * - ^ 

Prior to commencement of a training session, curriculum training staff should be oriented to the 
meeting facilities. They should know which orthe meeting rooms they will be usin^ for presentations 
or small group workshops. In addition, a curriculum training staff person should know where 
^podiums, microphones, and lights are located in each meeting room and how to operate them. 
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SUMMARY 

This manual describes a sequence of steps for developing and implementing an IPA model HMO 
training program. To provide a quick overview of this sequential process, the Introduction contains an 
IPA Model Training Program Flow Chart. The manual is then divided into four. sections each of 
which presents a phase of the training approach in detail as follows: 

SECTION I presents the PVe-Blanning Phase which describes the necessity of identifying the 
need for a training program and the training needs of the target population. Goals and objectives are 
derived from data gathered in a needs assessment study of the trainee population; a baseline 
information protocol study, and a review of the State-of-the-Art, 

SECTION II presents the Planning Phase in which objectives are identified and used to specify a 
training program curriculum. Possible curriculum topics, a curriculvun flow chart, training 
methodologiies, instructional aids ariS training session agenda are described. Selection of training staff 
is considered. , ■ 

SECTION III presents the Pre-Implementation Phase in which a curriculum staff training 
program and the development of instructional aids for that staff are implemented. Other 
considerations iii^ude logistical arrangements and motivational strategies to ensure trainee 
participation. . 

, , SECTION' IV presents the Implementation Phase in which the coordination of activities relevant 
to trainee registration, ohsite training activities, and specific training meetings are reviewed. 

While no manual or guide is ever complete, it is hoped that this manual will serve as valuable 
assistance to others who are attempting to conduct training programs in an IPA model HMO. 
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EXHIBIT I 
'Special Needs Assessment Form 



44 




michlgiin hmo plum^ lnc» 

0 non-profit corporotton 



EXfflBITI — ''Special Needs Assessment Form'V 



PLEASE USE BRIEF ACTION STA^tEMENTS 

1. WhAt vvould you like to^iave included in a training activity that would be beneficial to you in 
working in this center? 



2. What would you like to have included in a training activity that would be beneficial to you in 
working with HMO Central? 



3. c^What kin(te of changes would you like to see happen as a result of training? 



in 
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II. Follow are some terms and for each there are several definitionB. Place a check in the bos^xt to 
the one you think is most nearly correct when used in relation to HMOs. 



A. Capitation (for. HMOs) can be defme^^s: 

□ 1. An insurance premium, of which the amount depends on who the enrolled person is. 

□ 2. Some fixed amount paid per enrolled person. 

□ 3. Some fixed amount paid per enrolled person fo^a fixed set (package) of services. 

B. Fee-for-Service Feature of HMOs is: 

- □ 1. A porti(m of the funds which pays the higher compensation rates of members 
(doctors)lvvho are classified as consultants or specialists. 

s 

□ 2. A) port?5?i^ of the funds which pays ipedical services not provided by MHMOP but 

covered by the service package for the enrollees. 

ft , 

□ 3. A portion of the funds which pays for physiciian services rendered to the patient 

while in hospital. 

. ' . ■ . j • ■ 

C. Risk Sharing in HMOs: 

□ 1. Is a form of malpractice insurance. 

□ 2. Means that any deficit incurred by your health center will be directly paid by your 

group and your group alone. 

□ 3. Is a portion of^th^^total capitation set aside into a reserve {)&nd to protect the 

financial interests of all health centers. 



— Continued — 



4) 

/ 



ERIC 



48 




cftlfian hmo plans, Inc. 

►rorn. 



o non-prouicorporatton 



. Cont'd. 

D. Benefit Package in HMOs: 

□ 1.- An identical range of health services which are guaranteed by MHMOP, regardless 

of the medical group in which the individual ia enrolled for care. 

^ □ 2. The range of health services to which an enrollee is entitled and which is defined by 
the individual medical group contract. 

□ 3. Those health services deemed necessary by the patient^s physician. 

E. Referrals ta Specialists who are not under a capita^on contract with MHMOP are 
paid for by: / 

□ 1. The group to which the doctor making the referral belongs. 

□ 2. Out of capitation with prior approval of the MHMOP. 

□ 3. Out of the risk sharing fund with prior approval of the MHMOP. 

□ 4, Out of the fee-for-service fund with prior approval of the medical group. 

□ 5. None of these. (Please describe your understanding of this payment arrangement.) 



— Continued — 
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IIL Below is a list of service? wh'icK enrollees may either need or request from your groUp. For 
EACH check ONE box. • * ' 



V * 


Provided by^ ' . ■ 


Not 
provided 
at all 


W 

Don't 
Know 


1 

Health Service 

r 


Your 

ffTOUP 


Referral 
from you 


Referred 
" from MHMOP 
Center 




1. Prenatal Care 












EjyB vjri asses 












3. Rhino-plasts 
(cosmetic) 








1 - 
— ' — — 




4. Outpatient 
Studies 




• 








5. EKG & EEG 












D. ADortions 












7. Dental Care 










' ^ 


Outpatient *^ 












ft. Contact Lenses 












10. Emergency 
Room 
Services 












11. Tubal 
Ligation 












12. Vasectomy 












13. Inpatient 
Hospital- 
ization 













5v) 

i 

(Continued on next page) 
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(Cont^d) 





Provided by 


Not 
|)i^vided 
at' all ^ 


Don^t 
Know 


Health S^fAti^e^ 


Your 
group 


Referral 
from you 


Referred 
from MHMOP 
<uenter 


14. Dermatologists 












15. Allergists 








> 




16. Podiatrist 












17. Nutrition 
Counseling 












18. Health ^ ^ 
Care 

(domestic) 


« 










19. VNA 




* 








20. Psychiatric 

Tnnflifipnf 




— ^ — r 

*• 








21. General Surgery 


' ; 










22. Family 

Planning ^ 


/ 










23. Health 
Education 












24. Prescriptions 












25. Ambulance 












g 

26. Transportation 
(other than 
ambulance) 








V 
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III. (Cont'd) - ' , . 

When you talk to an enrollee about a request for a specific service, do you: 

□ 1. Refer to a written guide, list or set of instructions to help you. 

□ 2. Consult with someone in your office. 
Q 3. Call up the MHMOP Central Office. 

□ 4. Already know the answers because you have been doing this for so long. , , 

\ 

IV. Which of the following statements best reflects your experience with ^MHMOFs Central Qffice: 

A. In regard to enroUees* service requests: (CHECK ONE) 

' □ 1. People at the. MHMOP Central Office are unreasonable and demand special deals 
whenever a patient calls them up and makes waves. 

□ 2. When the MHMOP Center people call up about a service request, it*s usually a 

situation where they are justified in intervening. 

. □ 3. It*s hard to say; sometimes the MHMOP Center people are reasonable and other 
times they are not. 

B. In regard to complaints by patients: (CHECK ONE) 

□ 1. The MHMOP Central Office always takes the patient's side and doesn't listen to 

reason. 

□ 2. The MHMOP Central Office seems to make reasaaable evaluations of complaints and 

calls to our attention, usually on those where a problem does exist. 

□ 3. It is hard to say; pometimes the MHMOP Central Office seems to take iides, other 

times it seems to be reasonable. . . 



O Li 
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V. Now a final question. Please check the one statement that most closely reflects your experience in 
regard to Enrollment: \ 

□ ' 1. The people at the MHMOP Central Office v/ho-^enrolf new members either 4on't 
know about the services that are coverell or elpe t^y deliljerately. exaggerate just to 
"make a sale'', because most nevr enrollees dei]cpna much more than they are 
entitled to. . 

v/ . 0 2. Some new enrollees don't se^m to know what joining MHMOP meana and what they 
are entifled to, biit some new enrollees do know fairly accurately. 

^ □ 3. Most of the time^ new enj?^<^e8 know what they are entitled to and what enrolling / • 
means. ^ . 



Please ii^icate your function in your health center by checking the appropriate box: 

□ Patient Care: Physician • - 

□ Patient Care: RN, LPNj Medical Assistant or Aide, Receptionist 

□ Office: Administrator or Administrative Assistant, Manager, Typist, Clerk, Secretary, 

Billing, Accounting, Bookkeeping ' , * 

□ Other: Medical Records, Laboratory or X-ray Technician, etc? 




r 



THANK YOU! 



EXHIBIT III 
"State-of-Art Review' 
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exhibit iv 

dmf sample training program 
curriculum flow chart 



EXHIBIT IV 



DMF SAMPLE TRAINING PROGRAM 



TRAINING PROGRAM OBJECTIVES TRAINING CURRICULUM OBJECTIVES CONTENT DETAIL ' 



1. To improve the level of 
knowledge and informa- 
tion abbut important 
operational components 
of the Michigan Health 
Mamtenance Organiza- 
tion Plans, Inc. (^IHMOP) 

^ ampng'the ota£F of the 
In<iividual Practice 
;&2Cciation (IPA) Pri- 
mary Care Unito (PCUs) ^^ - 
in attendance at the 
training Eesaiono. 



la. 



To improve the level of 
knowledge about the diff- 
erence between health 
maintenance organizations 
and traditional forms of 
health care delivery 
among the PCU staff. 



b. 



To improve the ab?lity 
of PCU staff, to name 
the m£Mor divisions of 
MHMOP and the areas 
of responsibility of 
each m£^or division. 



Idr HMO CONCEPT 

(1) Definition of HMOs 

(2) How HMOs differ from 
other pre-paid health 
plans 

(^) Types of HMOs . 

(4) Patient rights in &n 
HMO setting • 



b. How MHMOP Opera(«s 

(1) Description of all 
I departments and 
divisions of MHMOP 
and their area of 
responsibility 



(2) Identification of 
department and 
division heads 

(3) Description of 
health services 
available via MHMOP 
central office 
referral 



(4) Explanation of 
Yee-for»service 
payments * 

(5) Description of how 
the Michigan HMO 
plan is marketed 



CURRICULUM FLOW CHART 



EXHIBIT IV 



INSTRUCTIpNAL 
METHOD 



INSTRUCTIONAL 
AIDS 



CURRICULUM TBAINING 

STAFF PERSON TIME 

RESPONSIBLE < SCHEDULE 



la. Lecturettes- 

question and answer 
sessions 



la. 



Slides'of supple- 
mental and basic 
health services 



la; 



(l)-(3) 

Senior Ejiecutivje 
Vice President 

(4) Corporate 
Counsel 



la. (l)-(3) 
1 hour 



15 

minutes 



Lecturettes, 
question and 
answer sessions, 
small group 
workshfops. 



b(l) ^MHMOFs organi- 
zational flow 
chart 



(2) Health ^are Admin- 
a istrati^ flow chart 



b. 



(l)-(2) Director 
of Heaith Care 
Administration 



(1M2) 
"'30 minutes 



(3) 



Manager of 
Health Care 
Administration 



(3) 15 

minutes 



(4) Manager of Claims 
Processing Division 

(5) Director of 
Marketing 



(4) 15 
minutes 

(5) 15 
minutes 
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EXHIBITV 

SAMPLES OF TRAINING 
SESSION AGENDA 





EXHIBIT V 



SAtURDAY — July 26, 1975 




DETROIT MEDICAL FOUNDATION 
EDUCATION CONFERENCE ON HMOs 
PHYSICIAN GROUP 



8:00 - 9:00 a.m. 

9:00 9:10 a.m; 

9:10 - 9:15 a.m. 

,9:15 - 10:15 a.m. 



10:15 - 10:30 a.m. 



10.30 - 10.45 a.m, 



10:45 - 11:00 a.m. 



11.00 - 11:30 a.m. 



11:30 - '11:45 a.m. 



1 1:45 - 12 Noon 



ERIC ' 



BREAKFAST (Rooms — Devonshire, Gad'o Hill and Dickeno Room) 

, Welcome William 0. Mays, M.D. 

(Ropmo — Betoey Trotwood and Preoident, DMF 

LukeHoneytitUnder) . President, MHMOP 

J 

General Introductions J^hn L Loomis. M.D. 

Project Director, DMF 

"What is an HMO?" W. M©Mn Smith. M.B.A. 

Vice President, DMF 
Senior Executive Vice 
President, MHMOP 

"Patient Rights" * Riehar^ T. White. Esquire 

Corporate Counsel 

Questions and Answers ..X Moderator 

^ \ John L Loornis, M.D. 

Project Director, DMF 

COFFEE BREAK 
"How Michigan Health 

Maintenance Organization ' , ' 

Plans, Inc. (MHMOP) 

Operates" ^- Larkin Isaac, M-B.A. 

' (Rooms — Betsey Trotwood and Director of Operations 

Luke Honeythunder) ^ 

"H^lth Services Available 
via MHMOP Central Office 

Referral" v Sandra Billingslea, M.S.W. 

, Manager Health Care 

|, ^ Administration Dimsion 

"Fee-for-Service ' , - • 

Utilization" • Bruce E. Mulltean 

Manager Claims Processing 

V ' • ^ ^ Division 



PHYSICIAN Gi^UP 



SATURDAY — July 26, 1975 (cont'd) ' 

/ & . 
12 Noon - 12:15 p.m. > "How the Michigan HMO Plan is Marketed" Fred Prime 

' Director of Marketing 

12:15 - 12:30 p.m. ' Questions and Answers Moderator 

^ John L. Loomis, M.D. 

J\ * Project Director, DMF 

, , . ■ i . ' 

. 12:30 - 1:15 p.m. WBRiAK 

1:15 - 2:15 p.m. LUNCH (Roomo-^BetoeyTrotwood and Luke Honey thunder) 

2:1S - 2.45 p.m. Luncheon Speaker T. H. BilJingslea. M.D. 

Executive Vice Preoident 
Health Care Administration 

2:45 - 3:00 p.m. BREAK 

3:00 - 4:36 p.m. Financial Structure of the ^ * * 

Plan (Room — Tilly Slowboy) 

Capitation Payment ^ 

Mechanism : Karl Haiser, M.B.A., C.P.A. 

^ ' Director of Finance 

Fee-for-Service Referrals 
and the Payment 

f Mechanism Bruce ET^ullican 

Manager Claimo Proceoeing Division 

Additional Comments W. Melvin Smith, M.B.A. 

^ , Vice President, DMF 

O Senior Executive Vice 

^ ' President, MHMOP 

4:30 - 4:45 p.m. COFFEE BREAK , . 

4:45 - 6:00 p.m. "Coblestone Conferences" 

Informal Small diroup Discussions with MHMOP Personnel 

(Rooms Tilly Slowboy, Betoey Trotwood and Luke Honeythunder) 
TOPICS: 

Health Care Services Sandra Billingslea, M.S.W. 

Manager Health Care 
Administration Divisio* 

' ' GO ■ • 

ER?C 2 ' ' • 
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/ 

IXTUR^AY — July 26, 1975 (cont'd) 



t 



4 45 - 6 00 p.m. (cont'd) Palldnt Referrals and Billing ^ 

Teehniealities of Referrals Bruce E. Mullican 

' * Manager ClahnB Proceming 

^ . Division 

^ '.I 

CapUated Services Haiser. M.B.A., C.P.A. 

^ Director of Finance 

Medical Records Alegro J. Godley, M.D. 

Corporate Medical Director 

Dorothy Douthitt. A.R.T. 

Medical Recordo Librarian 

Eitrollee Concerns Barbara Sue Brown, Supervisor 

Subccriber Serviced 

Enrollee Orientation Andrea Williams, Supervisor 

EnroUee Orientation 

6:00 - 7:30 p.m. BREAK 

7*30 - 8:00 p.m. Cash Bar (Roomo — Tilly Slowboy, Betoey Trotwood and Luke Honeythunder) 

:00 - 9:00 p.m. BANQUET DINNER o 

Introduction of Guest Speaker William O. Mays, M.D. 

President, DMF 

. President, MHMOP 

GUEST SPEAKER Paul M. Ellwood, Jr., M.D. 

President of InterStudy 

IMichigan Health Maintenance Orgailizationa Plans, Inc. 

Award Presentations William O. Mays, M.D. 

President, DMF 

^ ' President, MHMOP 

W. Melvin Smith, M.B.A. 

• Vice President, DMF 
Senior Executive Vice 
• President, MH MOP 

John L. Loomis; M.D. 

Project Director, DMF 

SUNDAY — July 27, 1975 \y ' 

9 00 - 10:00 a.m. BREAKFAST (Roomo — Devonshire, Gad's Hill and Dickens Room) 



00 - 10:30 a.m. "Effective Patient 

Management" Alegro J. Godley, M.D. 

(Tilly Slowboy ) - Corporate Medical Director 

■,Gi 
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SUNDAY — July 27, "1075 (cont'd) , , ; 

1®:30 - 10:45 a.m. Questions and Answers 

10:45 - 11:10 a.m. ''Corporate Dental Planning For 

Michigan Health Maintenance Organization 

Plana, Jnc/' San^yel L Thorpe, D.D.S., Ph.D. 

Corpomte Dental Director 

Moderator 

11:10 - 11:20 a.m. Ckiestions and Answers ... John L Loomi^, M.D. 

Project Director, DMR 

11:20 - 12 Noon • Summary 6t Conference John L. Loomis, M.D. 

Project Director, I^MF 

12 Noon Adjournment ^ 
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EXHIBIT V 





DETROIT MEDICAL FOUNDATION 
EDUCATION CONFERENCE ON HMOs 
ALUED HEALTH PERSONNEL 



SATURDAY — July 26, 197S 

8:00 - 9:00 a.m. 
9:00 - 9:10 a.m. 

9:10 - 9:15 a.m. 
9.15 - 10:15 a.m. 



10:15 - 10:30 a.m. 



10:30 - 10:45 a.m. 



10:45 - 11:00 a.m. 
11.00 - 11:30 a.m. 



F:30 - 11:45 a.m. 



11:45 - 12 Noon 



ERIC 



BREAKFAST (Roomo — Devonohire, Gad'o Hill and Dichena Room) 

- \ 

W©lcome • • William O. Mays, M.D. 

(Roomo — Betoey Trotwood and Freoident, DMF 

Luke Honeythimder) Preoident, MHMOP 

General Introductions John L. Loomis, M,D. 

Project Director, DMF 

"What is an HMO?" W. Melvin Smith, M^A 

^ » Vice Presid^MKbMF 

X Senior Executive Vice 
President, MHMOP 

"Patient Rights" Richard T. White, Esclujr© 

Corporate Counsel 

Questions and Answers Moderator 

John L Loomis, M.D. 
Project Director, Dl^F 

COFFEE BREAK 

"How Michigan Health . ' ^ . 

Maintenance Organization ^ . 

Plans, Inc. (MHMOP) 

Operates" !^ ^ O. Larkin Isaac, M.B.A. 

(Roomo — Beioey Trotwood and Director of Operatiom 

Luke Honeythunder) 

"Heatth Services Available 
via MHMOP Central Office 

Referral" Sandra Billingsleia, M.S.W. 

Manager Heaith Care 
A^mktnUion Dwman 

"Fee-for-Sen/ice . 

Utilization" « •■■ Bruce E. Mullicari 

Manager Claimo Processing 
Dwision 



ALUED HEALTH PERSOrlNEL 



SATURDAY — July 26, 1975 (cont'd) 



12 Noon • 12:15 T).m. ''How the Michigan H©alth 

. \Maint©nance Plan ia 

Marketed'* ^. Ff©d Prim© 

• Director of Marketing 

12:15 - 12:30 p.m. Questions and Answers : Moderator 

' John L. Loomis, M.D. 

, ' ^ Project Director, DMF 

12:30 - 1:15 p.m. BREAK 
1:15 * 2:15 p.m. LUNCH (RoomB — Betoey TrotwoodandLuh^ Honeythunder} 

2:15 - '2:45 p.m. Luncheon Speaker T. H. Bllllngsl©a, M.D. 

^ ^ Executive Vice President 

* • Health ^Care Administration 

2:45 - 3:00 p.m. BREAK 

3:00 - 3:45 p.m. . Slide Film • Moderator 

Cynthia L M. Johnson, M.P.K 

Deputy Project Director, DMl 

TOPICS: 

Aecbunt Executives Fred B^lrp© 

Director of Mdrk^ting 

EnroTlee Orientalion Andrea 'Williams 

Supervisor EnroUee Orientation 

' MHMOP's Hotline Sandra Billlngslea,^.S.W. 

Manager Health Care Admimstratioh 

Enrollee Concerns Barbara Sue Brown 

Supervisor Subscriber Services 

y ' • . 

3:45 - 4:30 p.m. * Small Group Workshops 

V GROUP I: Michigan HMO Plans' Enrollment Process 

(Room — Betsey Trotwood) 

« Presiding: Fred Prime ^ 

Director of Marketing 

^ Amyre A. Porter, M.A. 

Public Relations Specialist ^ 

GROUP II: Michigan HMO Plans' Enrollee 
Orientation Sessions 

(Room — Luke Honey thunder) 

Presidihg: Andrea Williams 

Supervisor Enrollee Orientation ' 
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ALUED HEALTH PERSONNEL 



\TURDAY — July 28, 1S7§ (cont'd). 




GROUP III: MHMOP'^ ••HOTLINE" 

(Ream — Devonshire) ^ 
c ' ^ 
Presiding: Sandra BilJIngslaa, M.S.W. 

Mimager Hefdth Cwre Admims^ratwn 

Yvonn© Ugorcak 

Emergency Triage Technician 

GROUP IV: Entoilae Ooncams 

(Hoom — CkM^D Hill) 
Presiding: Barbara Sue Brown ^ / 

Supervioor Subocriber Serviceo "\ 



4:30 - 4:45 p.m. A COFFEE BREAK 



4-45 - 6:00 p.m. "Cob!eston§ Conferences" 

Informat Small Group Dlscusaions with MHMOP Personrtel 

^ (Roomo — TUly Slcwboy, Betsey Trotwood and Lme Honeythunder) 



TOPICS 'J; 
Health Care Services Sandr^i Billingslea. M.S.W. 

Manager Health Care 
Adbniniatration Division 

Patient Referrals and Billing o 
' Technicalities of Referrals Bruce E. Mullican 

Manager Ckdmo Proceooing Division 

Capitated Services Karl Haiser, M.B.A., C.P.A. 

Director of Finance 

Medical Records Alegro J. Godley, M.D. 

Corporate Medical Director 

Dorothy Doutffltt, A.R.T. 

Medical Records Librarian 

Enrollee Concerns Barbara Sue Brown 

^ ^ Supervisor Subacriber Services 

Enrollee Orientation Andrea Williams 

Supervisor Enrollee Orientation 



00 - 7:30 p.m. BREAK 



7-30 - 8-00 p.m. ' ' Cash Bar (Rooms — fiUy Slowboy, Betoey Trotwood and Luke Honeythunder) 



SATURDAY — Jyty 26, 1975 (eonfd) 



ALUED HEALTH PERSONNEL 



8:00 - 9:00 p.m* 



BANQUET DINNER 

Introduction of Quest Speaker William O. Mays, M.D. 

President, DMF^^ 
President, MHMOf^m 

GUEST SPEAKER Paul M. Ellwood, Jr., M.D. 

President of InterStudy 

Mlchi^^n Health Malnt^rfance Organization 

Plan)©, Inc. Award Presehtattons < . .. William O. Mays, M.D. 

Presidem, DMF 

^ " Presideni, MHMOP^ 

^ , ^ W. Melvin Smith, M.B.A. 

C> ^ , ^ . . — Vice President, DMF 

\ Senior Executive Vice 

J President, MHMOP 

John L Loomi8, M.D. 
' Project Director, DMF 



SUNDAY — July 27, 197S 



}:00 a.m. 



10:00 - 10:40 a.i 



10:40 - 11:10 a.m. 



11:20 - 12 tsJoon 



\ 



12 Noon 



BREAKFAST (Roo^ — Devonshire, Qa&s Hill and Dickens) 

Appropriate UtlJIzation of 

M©dical R©cords >. \ Dorothy Douthitt, A.RjT. 

^ (Rooms — Betsey ^Trotwood and ' , Medical Records Librarian 

Luke Honeythunder) / Shirley Sumarlln, A.R.T. 

< ' Medical Records Technician 

Appropriate Utilization of p 
Michigan HMO Plans^ Encpimter^ 

Form r. ^ Jim O'Connor, M.B.^- 

Acting Directdr of Mcmagement 
^ Information Systems 

Summary of Conference John L Looml8, M.D. 

Project Director 

(Rooms — iHUy Shwhoy, Betsey Trotwood 
Luke Honeythunder) ^ 

' \ ■ ' \ 

ADJOURNMENT 

\ 
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PART 1: PROCESS EVALUATION 
I. INTRODUCTION - v 

{ 

^ A. TARP's RespoHisiibilities in the Demoestration Training Program ' 

This evaluation report of thfe Detroit Medical Foundation . Demonstration Training Program 
(DTP) is presented in fulfillment of contractual obligations undertaken on September 8, 1974 betwec^i^ 
TARP. Inc. and The Detroit Medical Foundation. Jin addition to the present evaluational activity, 
TARP also performed the following services for DMF: 

- Produced a comprehensive revie^w of the state-of-the-art of the health care training 
literature. (See Appendix 3) 

— Assisted in the development of the training curriculum. (See Appendix. 5) 

— Assisted DMF staff in the development of training logistics. 

— Assisted DMF staff in organizing and producing the final i^eport of the Demonstration 
Training Program. * r 

This report will aeeomplish the following* 

s . - ' 

Chronologically overview the DTP developmental process and evaluate key elements of 
that process. 

— Identify levels of success in the accomplishment of explicitly stated objectives and 
subobjectives. \ 

Identify areas^pf accomplishment which emerged as the program developed. 

— Assess the concrete tmeasurablej achievements of the DTP (impact analysis). 

— Document problems in the DTP developmental process that require improvement in 
future efforts. ' 

— Identify problem areas requiring treatment in future training efforts. 
— . Recommend future directions for DMF training activities. 

— Recommend future support activities in th^ HMO manpower development area that the 
BHRD might appropriately -undertake. 



B. Original Evaluative Objectives and Modified Evaluative Objectives 

As originally stated, the DTP evaluation was to consist of a process evaluation and an impact 
evaluation. While both evaluations have been accomplished, modifications were made consonant with 
the evolution of the DTP developmental process, aod were presented in TARPs Evaluation Design 
paper (see Appendix 6). The essential change in, format relates to (arose of patient-oriented data 
drawn from the MHMOP information system and (b) use of intra-group process skill data. Both of 
these data sets were dropped very early iji tjie DMF-DTP planning phase because it became clear 
that these data would not be readily forthcorning from the evolving demonstration design. 
Speci-ficjally, as the focus of training sharpened on (a) conveyance of basic HMO knowledge from 
MHMOP central office to member PCU's; and (b) improvement of intraorganization communications 
vertically (MHMOP central office — PCUs) and horizontally (inter — PCUs), the evaluation design 
ajso emerged as focusing on these main operational, objectives. Patient-oriented data was not 
mc^nitored and intra-group process skills data was not collected Therefore, the following evaluative 
instruments were utilized: (1) Direct observations of all planning meetings and conferences; (2) 
transcriptions and notes of all planning meetings and developmental work; (3) needs assessment data 
derived from three PCUs utilized during the design phase; (4) results of baseline and follow-up 
information protocols drawn from MHMOPs management planning section, which periodically 
assesses levels of information and knowledge among PCU staffs; and (5) an after-assessment of PCU's 
in attendance at the trainit^g conference. ^ 

C. Format of Presentation- 

The remainder of this evaluation report will contain; (1) the prcfcess evaluation; (^) the impact 
evaluation: (3) evaluation results and conclusions; and k4) recommendations for future HMO training 
activities. 

. ; ■ ' 71 



I\ Methods 

TARPs approach to the conduct of the process evaluation wa*s direct observation. TARP 
personnel cbnsulted with DMF staff, were present as observers at most planning session^ and 
observed all session of the training (conference) program and the one-day folLav/-up session. In 
addition, TARP has conducted a detailed content analysis of all written documentation accompanying 
the DTP. Finally, fARP has sought not merely to accurately describe the unfolding ^aga of the DTF, 
but to provide a conceptual (developmental) framework of the morphology of MHMOP. 
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II. NARRATIVE OF EVENTS 

The bTP included the following phases of activity: 

1. Proposahwriting, spbrnittal, and acceptance; contract/sub-con^ract finalization. 

2. Staff recruitment ^ ^ • 

3. Planning ' ^ 

4. Compx)nents development 

5. Training and follow-up conferences , - 

6. Final products development and program evaluation/ ^ 
ghlights of significant events from each pha.^fe'are described below. 

A. Proposal Writing, Submittal, and^ Acceptance; Contract/Siab-Contract Finalization: 
Februaairy — ,«July, 1974 ' ' 

On January 31, 1974, the Office of Special Programs, Bureau of Health Resources Deveiopmeht 
"announced^ t^e avaHability of tunds to help facilitate the development of health manpower in the 
context of HMO and pre-paid group practice settings. Shortly therea^r, the Detroit Medical 
"Foundation (hereafter, DMF) decided to undertake such a training venture as a service to its primary 
client, Michigan Health Maintenance Organization Plans (hereafter, MHMOP). At that time, 
Technical Assistance Research Programs (hereafter, TARP), was asked by DMF to participate in the 
conceptualization of a proposal and to undertake certain tasks within the project, should the proposal 
be accepted. 

The propossal was submitted on March 11, 1974. Notification of acceptance was received by DMF 
in early July, 1974. A contract with TARP was entered into on September 8, 1974, and work formally 
commenced on the Demonstration Training Program (DTP) during the last week in September, 1974. 
The project formally concluded on Noyi^mber 30, 1975. • 

B. Staff, Recruitment: July — Augyst, 1974 

During the months of July and August, 1974, DMF set about to recruit'key staff to implement 
the DTP. There was the need to find a new^project director since the individual initially identified in 
the proposal was unavailable, and a deputy project director. Finalization of these recruiting efforts 
delayed actual commencement of the DTFs operational phase until the latter part of September, 
1974 when a new projecf^rector came on hoard. ^ " ' 

C. - Plannimig; September, J974 — February, 19*^ 

The DTP planning process was a group effort involving: DMF stafC assigned to the DTP, 
consultants, and selected MHMOP staff, who were drawn in periodically, on an "as needed" basis. The 
period for planning extended from late 'September, 1974 to early February, 1975. By early February, 
the course of the DTP was largely set and a briefing meeting was held with t hex federal project 
officers' to in^cate the directions the project would take^ detailed review of planning activities 

follows. f * ' 

1. September 27 — October 10, 1974: Thidj period^ saw the start of the project. 
Responsibilities of the staff were delineated. Prime contractor and sub-.contractor relationships were 
established. The original DTP proposal was reviewed and up-dates and modifications were begun. 

2. October 11 — October 29, 1974: The state-of-the-art literature review was begun by 
TARP. A detailed work plan, specifying all project elements was developed. 

3. Octo,ber 30 — November 14, 1974: The structure of the DTP, in terms of an experimental 
design, was firmed up in specific terms. Selectiorx criteria for the six PCU training cohort were 
designed. Information requirements for curriculum design were determined and data collection 
strategies were discussed. 

4. November 15 — November -?5, 1974: ^inal decisions on the revised project methodology 
were ma(]e, including a time-phased work plan for completion of all remaining project requirements. 
Six PCUs which would serve as the training cohort * were selected. The first draft of the 
state-of-the-art literature review was presented by TARP. 

5. November 26 — December 18, 1974: Discussions with MHMOP commenced on the 
utilization of data from their management information system (MIS). Areas of priority for the 
training curriculum were determined. ^ 

6. December 19 ^^famiiuary 10, 1975: Information inputs and the training program role of 
MHMOP staff were deternWred. Finabdecisjons on the utilization of the MHM6p MIS were made and 



a needs assessment protocol was devised. These items constituted^aseline information inputs to the 
curriculum, training format, and evaluation. 

7.' (January 11 — February '6, 1975: The MHMOP MIS was utilized to determine levels of 
PCU staff knowledge. The needs assessment protocol was finalized. A briefing session with the 
federal project officers was held. 

Note: From February 7 through March 15, 1975, the DTP experienced staffing difficulties. The 
deputy project director was transferred and a new deputy project director was hired. No 
sabstantji^ work oin the DTP was accomplished during this period. 

D. Compoiaenlti Development: March — July, 1978 

During this phase of the DTP, all components necessary for the conduct of the three-day July 
training conference and follow-up (one-day) conference were designed. The activities undertaken 
were. 

— Currirulum design and ' 

— Training program format. 

.,1. March 15 — April 14, 1975: MHMOP MIS data on levels of kno^edge and information 
present at the PCU level was analyzed. Also, inquiries were made to MHMOP staff about t^ kinds of 
information required by the PCUs and how such information should be prioritized in the training 
conferences. 

"^2. April 15 — May 3, 1975: The needs assessment procedure was implemented three of the 
PCUs included in the training cohort. This exercise elicited specific information about the kinds of 
issues, questions, and topics ^hat PCUs felt should be covered in the training conferences. The 
consumer papel was covened and then input was solicited as'\to topics that shou|d be covered in 
training. / - ^ 

3. May 4 — May 8, 1975: The basic curriculum for tl^e training conference was drafted. It 
covered the five tojDic areas originally described in the proposal. 

4. May 9 — May 29, 1975: The basic curriculum was detailed out as to specific content. The 
curriculum content was reviewed, revised, and finalized. TARP submitted the final state-of-the-art 
literature review paper. 

5 June 1 — June 2, 1975: Meetings were held in Washington, D.C. with TARP personnel to 
coordinate plans f(^their observation of the training conferences and to identify the specific pieces of 
DTP data that were to be employed in both the process and impact evaluations. A briefing session 
was held with the federal project officers. 

6. June 3 — June 2f5, 1975: Logistics for implementing the training phase of the DTP were 
finalized including training strategies for the DTP training stafT, insuring that each trainer's 
presentation reflected guidance received from DTP project staff. A specific guidance format designed, 
to aid presenters in structuring their presentations was developed. Final arrangements were made 
with media consultants for use of slides and the "hot-line" presentation. A second meeting with the 
consumer panel was held and further issues of consumer concern were presented. Vigorus recruitment 
efforts were undertaken to ensure high levels of attendance at the July 25-27 conference in Ann 
Arbor, Michigan. 

7. June 26 — July 8, 1975: Final decisions on DTP curriculum, training formats, and ' 
logistical arrangements were ma4e. AIT^HMOP staff trainers were tasked according to the guidance 
format on how to struct^ire their presentations and which topics to cover and emphasize. 
Modifications in pre-con fere nee data collection formats were made in order to streamline 
administration at the follow-up trainiri^; conference session. ^ 

8. July 9 — July 24, 1975: MHMOP staff trainers worked with' DTP project staff on their 
presentations. A one-day ^'dress rehearsal" was held on vjuly 21. DTP staff worked with each 
presenter on an individual basis. Final logistical arrangements were made, including the structuring 
of the conference and coordination of audio-visual utilization. 

E. Training Conferences: July — August, 1975 

t 

1. July 25 — July 27, 1975: The first part of the training conference was held in Ann Arbor, 
Michigan. Approximately 150 people attended the day and one-half conference. During the 
conference, a short meeting with the federal project officer was held, and final product presentation 
formats were confirmed. 

7 1- ,. 



2. July 28 — August 6, 1975: Final preparations were made for the second part of the 
conference, a seHBion in Detroit, Michigan, held on August 6. « 

F. Fmal Products Development and Program Evaluation: August — October, 1975 

1. August 7 — October 15, 1975: Deliverable products were produced. All data from the 
conference was evaluated. The training manual was revised on the basis of experience. 

2. October 26 — November 30, 1975: Review and comment was provided by the Bureau of 
Health Manpower and requested revisions were discussed and accompMs»hed, 
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III. THE ORGANIZATIONAL CONTEXT 

In this section of the evaluation TARP presents an analysis of each component of the DTP. The 
purpose is to identify areas of success as well as problems requiring resolution in future training 
efl[orts. 

A. Geimerffll Obseirvation© 

In most complex organizations, training of staff is not placed high on^the list of priorities. By its 
very nature, training stands beside other tools of modern management as potentially threatening to 
the. organizational status quo. The trend in most organizations is to look to others outside the 
immediate unit or division to point out as being the source of what is wrong in the organizational 
system. 

But organizations do suffer from problems of internal management. And, more often than not, 
these internal problems are structural in nature, and rob even moderately well functioning 
organizations of their capacity to function even better. ' 

Another point that needs- to be stressed is that organizational survival ultimately depends on the 
capacities of organizations to learn. Learning is the ability to* reflect selt-consciousiy on the need to 
adapt to chan^ng environmental pressures, and to make those periodic adjustments necessary for 
organizational survival. ' ^ 

For these reasons, the self-consciously reflective organization recognizes the., utility of training as 
an important complinent of organizational development and adaptation. The decision to train is often, 
made by top management because they recognize the ultimafe need for such efforts. This perspective 
is often not shared by lesser units in the^ organization, however. Thus, the trainers are sent forward 
to do battle, \n 'dii environment of mixed interest^ind varying feelings about the training enterprise. 

Thes^ observations^ are by way of an appropriajte introduction to an analysis of the Demonstration 
Trjuning Program. ' 

B. MHMOP's Organizatfoin; A Developmeimtal Perspectiive==^ ^ 

MFfMQP is an independent practice'association (hereafter, IPA) HMO. This fact is not only an 
organizational reality of MHMOP\'^present and future, but a legacy of its past. An IPA-HMO is a 
modest innovation in the structure of a solo practice, fee-for-service delivery system. When an IPA 
model of HMO organizatiba. is selected, it is because HMO planners intend to utilize much of the 
medical capital already in place in the health care delivery system. 

The reality confror^ing DMF planners in 1971 was the following. Large numbers of physicians in 
the Detroit Metropolitan area were seeing patients through the Medicaid system. As a result, they 
were„ experiencing the usual administrative problems associated with payment derivative from third 
party vendors, rather than immediate cash transaction. A number of clinic operations (professionaP 
corporations) began* to spricig up so that physicians could pool their administrative overhead, and, by 
centralizing billing and record keeping, free themselves for their primary tasks of providing medical 
^ care. The DMF plan to establish MHMOP, then, was the next logical step in an evolving 
developmental process. SigniTicantly, therefore, the nucleus of clinics which joined toJbecome the core 
of MHMOP's PCUs, predated MHMOPs existence, as independent professional corporations. As the 
Plan grew, physicians in solo practice were urged to join together to form new PCUs. The 
independence of each PCU was guaranteed through contracts, whereby the PCUs agreed to serve 
MHMOP patients but could continue to maintain their individual practices. 

The fundamental independence of provider groups in ^he IPA-HMO model is that modeKs most 
important reality. It is the case with MHMOP, as well, and this independence of PCUs defines the 
Plan's intrinsic organizational character, and identifies many of its organizational problems. TARP 
will not dwell on the positive aspects of the IPA approach here. It has been written about extensively 
elsewhere. Rather, the organizational problems of the IPA model are of greater interest to us, because 
these problems both constrain and challenge the best efforts of training in the IPA setting. 

The chief problem facing MHMOP is the lack of control available to the Plan over its member 
PCUs. Their contractual obligations to the Plan are limited, i.e., physicians are only obligated to 
partial practice commitments to the HMO, reserving the balance of their time to private practice. 

Another problem facing MHMOP is that the Plan has grown rapidly by undertaking service 
, obligations to an ever increasing number of patients, requiring continqous expansion of the number 
of PCUs participating in the Plan. The central administration of MHMOP is, therefore, faced with the 
ongoing managerial problem of socializing an ever-widening cohort of PCUs to the HMO process, in 
an environment that contractually maintains a maximum amount of local PCU independence. 
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The need for socialization may be termed the "vertical'* organizational development dimension. 
The FCUs, by entering into contract with MHMOP, promise tp perform within the HMO setting. But, 
the reality is that they are novices to the HMO process and require guidance and technical 
assistance, if they are to perform as well-functioning members of^the "HMO team/' 

And, the HMO concept which the PCUs are being called upon to operationalize, runs directly 
counter to many Df the established patterns of medical care practice that have been operative in the 
pre-HMO, fee-for-service environment: ' a 

HMOs place great emphasis on the team concept of health care, requiring greater 
involvement of allied health personnel than in traditional fee-for<service settings. 

— , HMOs emphasize primary prevention, early diagnosis and early treatment, requiring 
physicians and allied health .personnel to see their patients much earlier in the 
"wellness-illness" .continuum, thereby decreasing, over time, the need for costly cufative 
procedures. 

^ — HMOs must maintain comprehensive reporting systems which require more complex and 
elaborate records systems than fee-for-service practices usually require. 

HMOs operate under a set of economic principles that run directly counter to the 
incentives provided by fee-for-service payment. Specifically, prepayment puts physicians 
at risk for costs that exceed actuarially determined prepaid premiums. 

In the contex^t of MHMOP, this means that the percentage of payments held back by the 
Flan to meet excess costs, will not be available for distribution to the PCUs, if they must 
be utilized to meet unanticipated medical care and operating costs. 

These are only some of the conceptual differences between HMO and fee-for-service practices that 
must be understood by PCU personnel. MHMOP's problem, then, is classic: How to alter the behavior 
of the PCU cohort, when the very nature of the IPA model reinforces both the contractual and the 
structural (vertical^ independence of the PCUs from the MHMOP's central administration? 

The DTP was viewed by MHMOP's central administration as a vehicle for facilitating the 
.socialization process, llui^ to accomplish this goal, the basic isolation of the PCUs from the central 
administration (vertical) and from each other (horizontal) had to be overcome. 

To MHMOP's ceatral administration, the underlying implicit objective of the DTP was to create a 
vehicle for socialization of the PCUs to be IPA-HMO model by reducing both the vertical and 
horizontal isolation present in MHMOP's administration system. If these gaps could even be partially 
closed through the implementation of the DTP, then important knowledge and information could be 
exchanged and attitudes fostering isolation could be (at least somewhat) overcome. 

* * * * * 

With these contextual observations, TARP has portrayed the envirot^tt^Ant within which the DTP 
undertook its work. What follows in a component-by-component review of DTP activities in order to 
highlight areas. of vSuccess and areas in need of further effort during subsequent phases of training. 



rv. PROCESS ANALYSIS OF THE DEMONSTRATION TRAINING PROGRAM 

A. Proposal Writing giiibmittal and Acceptance; Contract/Siub-Contract FanalBzation: 
February — jMly, 1974 

The DTP proposal was written in response to a solicitation from the Division of Associated 
Health Professions/ Bureau of Health Manpower/Health Resources Administration. As presented, it 
attempted to balance two fundamental interests: the federal interest for generalizability of experience 
from one HMO setting to others; and the loc^l interest to' utilize training to solve some perceived 
organizational management problems. The federal interest, of necessity, was on products; the local 
interest was primarily on process. These two objectives have not always been compatible. * 

Product-oriented objectives perceive the local program as a laboratory out of which can be 
developed identifiable products which can be applied in other organizational settings. By its very 
nature, a product-oriented objective tends to give a lower priority to the intrinsic behavioral needs of 
the specific organization serving as the laboratory. 

Process-oriented objectives, on the other hand, tend to be parochial in nature. They are geared to 
meeting the perceived needs of a specific organization 'at a specific point in time. Thus, 
process-oriented objectives focus on the immediate results of^a beVefi^ial nature that will accrue to an 
organization undergoing a training experience. 

From its inception, DMF and its client MHMOP, wished to implement a training^ program that 
would produce observable results — J:he conveyance of specific information about'the nature of the 
MHMOP sytem to M|lMOP's operating (PCU) units. Products of such ''an effort would be sufficient if 
they proved useful in the facilitation of this impact-oriented objective. The accomplishment of the 
federal objective, it was felt, should be satisfied, but not at the expense of meeting the fundamental 
objective of improving MHMOFs .system efficiency. 

The DTP, then, focused primarily on the resolution of immediate MHMO]^ systems problems. 
Products would be generalized from this experience, but the project would not begin with generalized 
objectives and impose them a priori on the MHMOP system. This point of view was consistently 
maintained throughout the DTP. 

B. - Staff RecroBtment:*«July — August, 1974 

This component of the DTP tooMonger to complete than originally projected because a search for 
an appropriate project director and deputy project director had to be undertaken. The originally 
designated project director was Unavailable to DMP' becau.se she had to assume^ major management 
respon«ihilities within MHMOP. Similarly, a deputy project director had to be recruited. 

When these problems were solvecjj others quickly developed. The project director selected was an 
accepted member of the DMF-MHMOP physician community. The decision^to select a physician with 
close ties to the principal subjects of training proved to be a wise judgment*^. However, many times 
throughout the project ,the director found him.self under severe time and scheduling constraints. 
While sufficient time wavS allocated to the DTP, his first commitment was to his patients, which 
meant that the DTP was of a lower priority than this primary commitment. It was not an 
insurmountable obstacle, however. 

The deputy project director proved more difficult. This individual was to be the focal point of DTP 
, developmental efforts. A person was recruited with (apparently) appropriate credentials. That 
individual was not up to the rigors of the DTP, and was transferred to another assignment in 
February, 1975. A new deputy project director was recruited and the DTP moved smoothly forward. 

The lesson from these staffing problems is that greater efforts should have been exerted by DMF 
to screen and recruit appropriate personnel early irt the project. As the project unfolded, however, 
staffing problems tended to be resolved, but at some cost to planning efficiency. 

C. Planning: September, 1974 — February, 1975 

The planning phase bf the project, while successful in the aggregate, took longer to complete than 
had been expected. There were two reasons for this: <a) the staffing problems alluded to in B. above; 
and (b) the need for DTP staff to orient MHMOP staff to the specifics of the objects of training. This 
latter problem deserves further elaboration. 

v While l^IHMOP top management perceptively understood that there was a great need to better 
communicate information from the Central Office to the PCUs, they did not fully realize the need for 
developing a structural mechanism to facilitate that communication. Nor did they perceive the true 
levels of' ignorance of the MHMOP system and the lack 9f a feedback mechanism from the PCU level 
to MHMOP Central Administration. 

O 
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These dmuMiMons of the process-oriented elements of organizational management came to light 
during the unfolding of the DTP planning' and components development .stages. They were not,^ 
^however, fully anticipated as issues by either the DTP staff or MHMOP Central Administration, 
^While it was extremely useful to the MHMOP system that these issues came to the fore, their 
emergence greatly complicated the overall implementation of the DTP. ^ 

D. Components Development: March — July, 1975 

The live information categories li.e., finance, marketin^^ health services, operations, and 
information systems) were the focal point of curriculum design. That these five categories were the 
correct areas of focus was clearly verified through needs assessments interviews held with the PCUs, 
and through examination of information levels present in the PCUs. Both inquiries indicated much 
Ignorance about MHMOP at the P(UJ level. The task of the curriculum, therefore, was firmly directed 
toward designing a training format that would overcome this ignorance. • 

It also became clear during this phcjse of the DTP that MHMOP central oHice stafT would greatly 
beijefit from dirtict, contact with the P(UIs. As the data reviewed in the impact analysis section of this 
report reveals." MHMOP ^4aff were quite ignorant of precise levels of information present at the PCU 
level In ^hort. the DTP uncovered a wide gulf between (\'ntral Office and P(UJs that had to be 
bridged. . . 

K Training Conferences: fJIuly — August, 1975 

The training conference may be evaluated on two levels: Ui) as a means for improving the 
MHMOl' communications process and <b) as a vehicle for conveying specific information. TARP's 
conclusion is that the former objective was more -iuccessfully achieved than the latter objective. This 
point will be elaborated more fully in the impact analysis section of this report. 

F Final Products Development and Program Evaluation: Auguj^t — October, 1975 
The DTP did achieve the federal objective of demonstration products d'evelopmerit. The utility of 
these products for other HMOs will require further testing in those contexts, the TARP evaluation, 
while accurate and objective, labored under the (exigencies of poor evaluative data, owing essentailly 
to the inabilitv of MHMOP stil'ff, both Central Office and PCU. to handle written materials. 

The explicit objective of the DTP was to tram VVVj staff in workings of MHMOP. Underlying the' 
perception by MlfMOP's central administration that basic information about the MHMOP operation 
was not being effectively communicated to the P(^Us. was the reality that no structured channel for 
such communication was present in the MHMOP organizational system. 

Only recently a newsletter, produce^d by the (\*ntral Office, has become available to the, PCUs. 
Beyond this vehicle, periodic meetings of the Board of Tru.stees discu.ss top management i.ssues. These 
meetings usually do not go into "micro"-level discussion of day-to-day operating problems. Moreover, 
information provided to P(UI pre.sidents does not routinely filter dg.wn to PCU rank and file staff, 
either phvsician or allied health. 

The primary direct contact between P(^U rank and file staff and MHMOP (^entral Office, then, 
has been routine (indirect) contacts: patients who have been enrolled appear at clinics to seek care; 
referrals are made by MflMOP from one clinic to another; a complex and often ]?ewildering array of 
records are required of PCU staff by MHMOP with no clear understanding on the PCUs part as to 
why such records are nece.s.sary; affer hours emergencies are referred via MHMOPs hot line. These 
contact.s are invariably initiated V MHMOP and impose responsibilities and burdens on PCUs, 
without adequate opportunity (given the lack of two-way communication) for them to ask questions 
and indicate the sources of their confusion and frustration. 

A further area of contact occurs when MHMOP staff alert PCU staff to problems \Cith iDarticular 
patients who ha^' either complained or have di.senrolled. This type of contact is. by its very nature, 
negative; the (\'ntral Office is calling tx) tell the PCU .something decidedly unpleasant — that they 
have, in the eyes of the patient, either mistreated him or lo.st him through disenroUment. 

The vertical fragmentation of the IPA-HMO model builds in isolation between central 
management and practitioner units. If the only routine direct contact^; between these two 
organizational components are negative in tone, then the result can only be (a) the belief by central 
staff in a general lack of concern andor competence on the part of PCU staffs; and (b) the belief by 
F^(^l^ staffs that they are being .somehow manipulated by the central administration and, because 
they have not been provided with adequate knowledge, and information about what their 
responsibilities are within the MHxMOP setting, the feeling that they are being unfairly criticized for 



doing things they did. not know should have been done in the first place. ."^istfangement and hostility 
between both groups will increase, as the HMO system grows more compjex and the incidence of 
problems increases. This estrangement can only be resolved through mutual communication and 
accommodation which must be routinely structured into the HMO's organizational system. 

Prior to and during the duration of the DTP, no such structured communications process was 
present in MHMOP. The DTP, however, came to fill that void, albeit tentatively, and in a limited 
and, perhaps, only temporary way. For, by establishing a framework to design a training program, 
the basis (5f two-way communication was established for the simptle reason that the DTP required 
feedback from PCUs about what they thought ought to be in a training curriculum, i.e., needs 
assessment and baseline protocol. Conversely, Central Office staff were, for the first time, placed in a 
setting where they directly heard from PCUs regarding their levels of knowledge, misunderstandings, 
lack of information, etc. This contact enabled MHMOP staff to adjust their own attitudes about the 
PCU staffs to whom they would convey information' through the DTP training conference. 

In sum, MHMOP has long su-ffered from the vertical fragmentation intrinsic to the IPA-HMO 
model. Isolation and hostility at the PCU level have increased as the system has grown more 
complex. The Central Adr^nistration has also found itself isolated as its own work has become more 
complicated Open communication between PCUs and Central Adm^inistration has become 
increasingly necessary over time both to reduce the growing senne of mutual estrangement and 
hostility and to convey routinely needed information, in both directions between Central Office and 
PCUs. Rapid functional growth and diversity, however, has led to organizational lag, whereby the 
permanent structure for communication has not been constructed. The DTP has been the first step in 
this organizational development process. Ho{)efully, it will not be the last. 
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V. mb:th()ds 



FART 2: IMPACT EVALUATION 



Thi>> aspect of tjje evaluation report presents TARPs analysis of the impact of the entire DTP 
efTort-.The classic research model to assess the occurrence of desired change is the "controlled before 
and after" expe^-imental design! This design calls for selecting two groups, the "experimental group" 
which IS exposed to the training effort and the "control group" which is not so exposed. Measurements 
of levels of information and attitudes for both groups are made before the training effort and 
afterwards Findings from the comparison of "before and after" dala are analyzed to establish (1) 
any significant change in level of information and attitudes has occurred; (2) if such changes ar6 in 
^he dev^ired direction: and (3) if the observed changes may be attributed to the training effort or must 
be attributed to other factors. A detailed description of this research design's logic may he found^in 
Appendix 6, Kvalimtum Component Design for the Detroit Medical Foundation Oemonstration 
T nnniu^ Program, particularly pages 5-11. ^ 

.•V . The Proposed Research Design ; 

The specific design adopted called for the selection of entire PCII staffs as population units. The 
alternative^ possibility ^Jf pooling all personnel from all P('Us, stratifying this pool by job classification 
le g., MI) , R.N., receptionists, etc.) and pulling an experimental and a control grt)up from this pool 
was rejected. The factor considered most significant in this choice was the problcni of contamination 
between individuals trom the experimental and control groups if they happened to be in daily contact 
in the same PCIJ. A second factor given weight in this decision to consider PCUs the basic population 
unit was that MHMOP structure i« such that PCUs and not individual staff members of the PCUs 
are the units with whpm the relationshjps exist. The PCU staff is employed by the P(>U not MHMOP; 
the PCl^ nurses do not relate to MHMOP as nurses but as staff of the PCU. ; 

The early recognition that MHM()P (\>ntral Office staff, though involved in the training as 
"teachers," also could be expected to be influenced by participation in the training effort led to the 
( decision that there should be some form of "before and after" measurement for this group also. ^ 

The decision to involve the PCUs in the development of the curriculum by means of Veeds 
iissessment meetings permitted a further refinement, of the basic design. The possibility presented 
itself to evaluate the impact of involvement in the planning process on learning. (\)nsequently, the 
design called for the further selection of PdJs within the experimental group to establish a "control" 
group w|iich would not participate in planning by means of involvt^rjnent in needs assessment, and an 
experimental group which woujd participate. 



The basic design/ as planned is shown in Figure 1. 
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The four i4) analytic groups were: * ; . 

A<rf B: . 

A +'B: Experi mental* PCU cohort of 6 PCUs 
^ A = 3 PCUs^inveta^ed in Needs Assessment d 

B = 3 PCUs not involved in Needs Assessment , . ' ^ 

C: Control PCU cohort of 2 PCUs- 

D: Cohort of MHMOP CentrarOffiee Staff of 11 persons. . 
B. Impiemeotation and Modification of the Basic Design 

The execution of the ilmpact evaluation^phase met with' all the problen^M usually encountered 
when an ide^l design is applied in the real world. The modifications which had" to be instituted, as 
well as the resulting implications for the analytic scheme were significant. - , p 

1. Selection of PCUs for Experimental and Control Gro,ups 

The 18 PCUs p^articipating in MHMOP at .the beginning of the DTP varied considerably in terms 
of size of staff, type -of care provided, length of membership and degree of conflict within PCU an^ 
between PCU and MHMOP, as well as degree of Commitment to the principles of t^e HMO modality 
of providing medical care. While many of these differences among PCUs were not documented, they 
were neverthelesj^ perceived to be real by MHMOP, both by the central office staff and the Board. A^ 
a consequence, the selection of eight PCUs to participate, either as experimental or control cohorts, 
was not random in any sense of the statistical meaning of this word. Instead, the Board approved 
eight PCUs for inclusion ]n the DTP, leaving allocation as experimental or control group cohorts to 
^*the DTP staff. As a result, the PCUs selected are not a representative sample of all PCUs. in 
* MHMOP. ^ > • 

' As IS usually the case, the judgments of the Board and MHMOP appeared quite justified: The 
degree of commitment of individual PCUs^to HMO concepts and, consequently, the individual PCU'b 
degree of co-operation with the DTP varied as predicted.- * ^ 

2. Development of Instruments and Data Collection 
- ' a.- "Before'' Assessmrjent ' 

TARP agreed to jutili^e a questionnaire used by MHMOP's MIS to assess PCU staff members' 
level of information and attitudes for baseline "before" assessment. This instrument (Appendix 2) was 
administered under MIS auspices. The individual PCUs were provided with enough copies for all staff 
^and asked to complete the questionnaires and return them by a certain time. The questionnaries were 
processed at the Central Office, and TARP was provided with the tabulations. 

TARP asked that the Central Office 'staff, constituting analytic group D, fill out the same 
questionnaire by predicting the distribution of responses for four' categoreis of PCU staff: (1) 
Physicians, (2) Nurses and other personnel in contact with patient^, (3) managerial, administrative or 
office personnel, and (4) technical other personnel such as lab^echnicians, medical records clerks, etc. 

The- attempt by MHMOP to collect this information from PClJs revealed that a large number of 
PCU staff of all levels refused to participate. Intense effort wa^-equired to obtain the amount of 
participation finally achieved. For* the eight PCUs of interest, the return rates were as follows: , 
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Table 1 

RESPONSE TO "BEFORE" QUESTIONNAIRE 



PCU 



A 
B 



D 

E- 
F 
G 
H 

Total 



Nimiber of 
■^tafT 



Q uestionnaires Returned 
Number Percent 



10 


2 




20% 


4 


3 




75 


12 


2" 


+ 3 "Don't 


■ 42 ' 






Know 




14 


3 


+ 1 "Don't 


. 29 ' 






Know" 




15 


2 




13 


10 


7 




70 


9 


9 




100 


10 


3 




30 


74 


31 


+ 4 =35 


47% 
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The response from the Central Office staff resulted in eight useable sets of predictions. 
The difficulties encountered by the Central Office in obtaining co-operation with the 
questionnaires proved to be valid indication of the chasm that appeared to exist between the PCUs 
and the Central Office. There were hostile comments with the refusals as well as expressions of , 
' frustration. Comments ranged from a polite '*too busy" to "this is another phoney smokescreen" Snd 
, unrelated comments which expressed chronic despair with perceived policy positions and bureaucratic 
• ' - deafness. ^ ' r 

The questionnaire itself asked about knowledge and attitudes about the ^HMOP organizational 
structure, knowledge about HMO features, knowledge about the provision of individual services for 
enrollees, information seeking Hbehavior, and finally attitudes about the Central Office. ^ 

The data obtained was so sparse that the planned analyses by four categories of PCU personnel , 
was a'bandoned, and usually only the distinction between physieans and all other personnel could be 
- maintained. The data will be presented below. At the time, findings were used by DTP Staff for the 
Needs Assfe^ment Meetings. , 

b. "After** Assessment 

The preferred choice of the "after" assessment instrument is the original one devised for the 
"before" assessment. This usually is based on the assumption that the curriculum content is known, 
and that testing before and after will focus on the areas which are addressed by the curriculum. In 
the DTP instance, the curriculum content was not at all specific at the time the ^Ttieffore" assessments 
needed to be done. It was fe,lt that the curriculuyi development required the needs assessments 
conferences to obtain PCU input, and these conferences were originally scheduled much earlier than 

' the time at which they finally, were held. In order to obtain comparable data for the A group, the 
baseline data were collected with an instrument w|iich was not tailored specifically for the 
curriculum. It was, consequently, not entirely suitable for the "after" testing. In addition, the format 
of the MIS questionnaire had proven to be difficult for respondents. It was therefore decided that a 
revision of the original instrument would have to be produced. MHMOFs MIS needed such a revision 
* in any case, and TARP assisted in this task. They developed the adaptation for MIS use and, at the 
same time, to serve as an "after" test. 

This questionnaire was distributed at the August 6th session, which was not attended by all the 

' individuals who had participated in the first phase of the training sessions. At the banquet dinner 
during the first training conference in July, 68 persons had completed a brief questionnaire titled: 
"Yqur Opinion Please.** Of these, 10 were physicians. At the second phase, 55 persons completed the 
"after" questionnaires, 7 of these were physicians. However, on analysis it developed that some of the* 
persons participating in the training sessions originated from a PCU which was not one of the six ^ 
selected as experijjyfental cohort PCUs. To confound the awaJytic problem, it was discovered^hat this 
particular PCU had not been approached in the initial attempt to obtain information silice this PCU 
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is not a "clinic" but provides psychotherapeutic services. It proved, hence, impossible to add the PCU's# 
data to the "before" .data. However, a comparison of that group's responses to the other non-physician 
staff responses revealed no clustering of responses that would produce a bias, and it was decided to 
retain these responses. 

The Central OfTice staff, once again, was asked to use the questionnaries given to the PCU's and ^ 
to indicate' their prediction of the distribution of responses. They Tilled out two sets of questionnaries 
each: one for physicians and the sepond for all other allied health personnel. Thirteen sets of - 
questionnaires were completed, • ^ 

Finally, MHMOP attempted to obtain completed questionnaires from the two PCUs "constituting^ <^ 
the control group (c). So few responses were obtained that no findings will be presented. In addition, 
through errors in logistical arrangements, staff from the two control PCUs attended the Ann Arbor f- 
Conference, thereby invalidating any data cdlected from this source. However, in order, to provide a- 
quasicoritrol group, data will be presented from persons who attended the August 6th session and 
filled out. the questionnaire despite the fact that they had not attended the Ann Arbor session. 
Clearly, this group is not an altogether acceptable substitute since they are self-selected and, also, 
interested and motiviited enough to attend part of the training procedure. 

All the data that was obtained will now be presented. 
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VI. FINDINGS 

The tabulation of the, data for all instruments' revealed a rather interesting degree of inability to 
follow instructions. There were no complex directions nor anything unusual in the questionnaires to 
indicate that it was the questionnaire that provided the stumbling block. In any case, so many 
individuals coped incorrectly with some of the items^ that not Ml data ^ was complete enough t© 
warrant presentation. • 

A. "Before** Assessment of PCUs 

The first question provided a list of the nine (9) departments and sub-departments in the 
MHMOP Central Office and .asked if the respondent Hnew or did not know of the existence of ^ach. 
Table 2 shows the distribution of the responses for physicians and all other staff labeled Allied 
Health Personnel (AHP). *'No responses" (NA) were grouped with"^*no, did, not know" answers ^or 
simplicity of presentation. Overall, Administration was known by most with 84 percent, while 
Systems and Operations were known to only about 60 percent.* The physicians as a group knew 
equally frequently about Administration and Health Services with about 90, percent for each, while 
the remaining answers were in the *'did not know" category for these two items? 

The Allied Health Personnel (AHP) also reported Administration qs known to exist most 
frequently with 83 percent. However, this group reported knowledge about Medical Records and 
Finance next most frequently with about 78 percent for each. This undoubtedly reflects realistically 
the nature of the routine contacts between PCU ^personnel and the Central Office: the various PCU 
employees, by the nature of their specific tasks, will deal with Me_dical Records or Finance; physicians 
will deal with Health services, i.e., rel^rrals and patient recourse to the Hot Line in off hours. 

Table 2 ' * . ' . 

KNOWLEDGE ABOUT DEPARTMENTS IN MHMOP CENTRAL OFFICE 
'BY PCU PHYSICIANS AND ALLIED HEALTH PERSONNEL (AHP)* 



Department 


Total {N=32) 
Percent' 




M.D.s(N- 
Percent' 


9) 


AHP (N- 23) 
Percent' 






Did Not 






Did Not 






Did Not 






Knew 


Know 


N.A.2 


Knew 


Know 


N.A/-^ 


Knew 


Know 


N.A.2 


Administration 


84 


3 


12 


89 ' 


11 




83 




17 


Marketing 


66 




16 


67 


22 


11 


65 


17 


17 


Public Relations 


66 


22 


12 


67 


33 




65 


17 


17 


Systems 


59 


22 


19 


56 


33 


11 


61 


17 


22 


Medical Records 


75 


9 


16 


67 


22 


11 


. 78 


4 


17 


Finance 


72 


16 


-12 


56 


44 




78 


4 


17 


Operations 


59 


22 


19 


>56 


' 22 


22 


61 , 


22 


• 17 


Health Services 


69 


9 


.22 


89 


11 




61 


9 


30 


Health Education 

= — ~ 1_ 


63 


25 


12 


67 


33 




61 


22 


17 



^Rounded^ay add to 99^^ or lOl'f 



*St»e Appendix 2 for text oPQ I 

The surprising findings consisted of the reported low level of knowledge about Marketing and 
Health Education. The former was interesting since, as will be shown later, much of the basic 
disagreement between PCUs and Central Office center^ around the question of enrollee expectations 
about services to be, provided them i?y the PCUs. It would appear that PCU personnel frequently 
blamed the unspecified ''they" for overselling HMO services, but did not question how this 
"overselling" vwas coming about. The relative inawareness of Health Education, particularly in the 
case of the physicTans, appears^ to indicate that one of the operating principles of HMOs, namely 
prevention and education, has not been conveyed efTectiv^dy. The Health Education department is, ir^ 
fact, relatively recent, arid may not have h^d a chance as yet to have made its presence felt. 



A j^roup of five questions were concerned with knowledge-, about HMO teams and operating 
principles. Tf?e -Sormat was a multiple choice one. Table 3 presents the distributions of answers for 
physicians and AHP. Percentages are shown for correct answers. The five aspects selected were: 

(^apitation in HMOs * 

Fee-for-service 

Risk Sharing m HMOs 

Benefit Package in HMOs 

Referrals to Specialists outside capitation contracts with MHMOP 

n 

Table 3 



HMO Feature 



KNOWLEIKiE ABOUT HMO FEATURES, BY PCU PHYSICIANS 
AND ALLIED HEALTH PERSONNEL (AHP)^ 



Total iN 32) 
, Percent' 

^ Don^ 

Wrong 



Capitiition 
F(*e-f()r-St»rvice 
Risk Sharing 
Fk^nefit Package 
Special 1st 
Referral 



4 



Right 



28 


56 


3H 


44 


66 


19 


38^ 


41 


47 


41 



Know 

9 
9 
9 
6 

. 9 







M.D.S (N 9) 






AHP (N - 23) 






Percent • 






Perce njj^ 








Don't 








Don't 


n.a;^ 


Right 


Wrong 


Know 


N.A.'^ 


Right 


Wrong 


^Know 


















44 


56 






22 


56 


13 


' 9^ 


44 


56 






35. 


39 


13 


' 6 


67 








65 


13 


13 


16 


44] 








35 


35 . 


9 


3 


56) 








43 


39 


13 



















N.A.^' 
9 

13 
9 
22 
4 



'KniiruJed, riiav -ttld up tn (J'J'f f)r Inl'. 
'N A N'ut .\rKwt*r<*(l 
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^ The overall level of correct information was very low, indeed only the Risk Sharing question 
received a majority of correct answers from both physicians and AHPs. The AHPs' level of 
information ^as low, but since, in a sense, -none of this is of direct significance to them in their work, 
this is not too surprising. However, the physicians appeared not much better informed. 

A word of caution appears in order- here. The number of physicians (9) is of course extremely 
small and the results are to be interpreted with great caution. However, to anticipate*, attention is ' 
called to Table 18 shpwing the distribution of correct answers to these same five item'*4i)r i^hysicians ' 
"Fiefore" and "After'' as well as for the "Not at Ann Arbor" group. Grouping the "Before" and "Not at 
Ann Arbor" responses^! before training and without training), the percent correct for 14 physicians 
were as follows: 

Capitation 6^4*'^^ 
^ Fee- for-wSer vice ^ 64^y 

Risk Sharing 79^/r 

Benefit Package 50*'/f ^ 

Specialist Referral 64*'/r 

In€\scapably, we must conclude that physicians are' not as well informed as might be desired. 

The PCL^ staffs' knowledge about the availabilty of an arrayof specific services was also tested.' 
Table 4 presents th^^ ^listribution of correct and incorrect answers for all respondents.. Physicians and 
AHP are not reported separately since the differences for individual items did not reveal any 
significantly different patterns. Uniformly, the level of information is \6w. Correct information was 
shown most frequently for Prenatal Care: 76 percent answered correctliv. Seven further items were 
correctly answered by between roughly a half to three quarters of the respondents. Thcfee were Tubal 
Ligation 73 percent, Inpatient Hospitalization 73 percent, Nutrition Counselling 70 percent, EKG and 
EEG 67 percent General Surgery 65 percent. Outpatient X-ray Studies 61 percent, and ^^k^dy 
Plannjing 57 percent. Perhaps the most interesting finding is the relative low proportrSn of 
individuals who stated that they did not know as compared to the promrtion who poss4?ss wrong 
information. _ iflk 
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Table 4 



KNOWLEDGE ABOUT THE PROVISIONS' 
OF SERVICES, BY PCU PERSONNEL* 



f*CU PERSONNEL (N= 
Percent' 



32) 



Service 






Don't2 


• 


Right 


Wrong 


Know 


ff^enatal Care 


76 





12 


Eye ( J lasses 


10 


70 


10 


Rhino-PlaHts-Cosmetic 


Itf 


60 


17 


Outpatient X-Ray Studies 


. 61 


26 





KKG and EE(i 
Ado rt ions 


67 
47 


23 
37 




3 ' 


Dental Care 


29 


58 





Psychiatric Caret-Outpatient 


3 


77 


10 


Contact Lenses 


3 


72 


14 


E-R Services 


5 


81 




Tubal Ligation 


^3 ^ 


13 ' 


3 


Vasectomy , ^ 


37 


37 


13 


Inpatient Hospitalization 


73 


13 




Dermatc)logists , 


id 


38 




Allergists 


40 


43 


/43 


Podiatrists 


47 






Nutrition Counseling 


70 


11 


11 


Health Care-Domestic 


10 


57 


23 


VNA 


10 


48 


29 


Psychiatric Care-Inpatient 


14 


66 


10 


General Surgery 


64 


23 


3 


Family Planning • ^ 


57 


30 


3 


Health Education 


39 


,39 


12 


Prescriptions 


6 


74 




Ambulance 


32 


45 


13 


Transportation 


45 


32 . 


13 



'Rounded, may add to 99^ or 10 
*No AnHwers not «hown in Table 

*S<'e Appendix A for text of Q III , 
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* . One question dealt with the way PCU personnel handle giving information about specific service 
requests. Table 5 shows the distributions of answers. Physicians and AHP differ in the proportions 
who consult Homeone in their office, 46 and 6 percent r-espectiz/ely, and those who call up MHMOPy 
with 15 percent of physicians but 35 percent of AHFs resorting to this way of obtaining information. 
Interesting^ is the low reported use of written materials. \ ' - 

' ' ' y , Table 5 

HANDLING REQUESTS FOR SERVICES BY ENROLLEE, 
' . BY PCU PHYSICIANS AND ALLIED HEALTH PERSONNEL (AHP) 

Q UI "When you talk to an enrollee about a specific service, do you:'** 



Respon.se 

1^,^ 

Refer to written materials 

Consult with .someone in your office 

up the MHMOP Central Office 

Already know answers because been doing 
this for so long #- 

No Answers, More than 1 

Total 



Total 
(N -32) 
Percent ' 



7 
23 
27 

23 
20 



100 




M.D.s 
(N-9) 
Percent ' 



46 
L5 

15 
23 



99 



AHP 

(N -23) 
Percent ^ 



12 
6 
35 

29 
18 



100 



'liuundcd. ni.iv add to ^1 or U)V 
\S«»t* App<'ndjx 2 for text of ( 
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Two questions v^ere asked to elicit attitudes towards the Central Office's handling of problems 
relating to enrollees' j^ervice requests and complaints. Table 6 shows the distributions of responses. 
Physicians are more critical than AHP. No AHP felt that the Central Office is unreasonable, but 
some proportion, eight percent, of the physicians did. Further, physicians more frequently felt that 
the Central Office was sometimes reasonable but not at other times than did AHPs, 61 and 29 
percent respectively. The largest proportion, 59 percent of AHP, felt that the Central Office service 
requests are usually justified. It is indeed interesting to note that extreme attitudes were reported 
relatively infrequently. 

Table 6 

ATTITUDES TOWARDS MHMOP CENTRAL OFFICE'S HANDLING 
OF ENROLLEES' SERVICE REQUESTS BY PCU 
PHYSICIANS AND ALLIED HEALTH PERSONNEL (AHP) 

Q. IVA: "In regard to enrollees' service requests: (CHECK ONE)"* , . v 



Responses 


Total 
(IN =6Z) 
Percent' 


M.D.8 
( IN = y ) 
Percent* 


AHP 

f IN — Zd) 

Percent' 


"People at the MHMOP Central Office 
are unreasonable and demand special 
deals whenever a patient calls them 
up and makes waves." 


3 


8 




"When the MHMOP Center people call 
up about a service request, it's 
usually a situation where they are 
justified in intervening/' 


43 


23 


59 


"It's hard to say: sometimes the 
MHMOP Center people are reasonable 
and other times they are not." 


43 


61 


29 


No Answer, More than 1 answer 


10 


8 


12 


Total 


99 


100 


100 



'Rounded, mav add up U) 99^^ 



>^ *S*'<* Appendix 2 for U»xt f>r Q IVA 
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Table 7 shows the responses about Central Office handling of complaints. Physicians and AHP 
differ in their attitudes towards the Central Offices with the AHPs seeing the Central Office 
generally being reasonable (65 percent) while physicians more' often (61 percent) see the Central 
Office sometimes taking sides and other times being reasonable. Again, the extreme view of the 
CentKal Office is not held for this question by any individual. 

The final question related to enrollees' knowledge about the services to which they are entitled, 
and the Central Office's culp'abilty in misconceptions. Table 8 shows the results. No AHP individual 
thought most enrollees well infoismed, but 23 percent of the physicians did so. Both groups most 
frequently took the middle position with two-third of the AHPs andv^out 40 percent of the 
physicians doing -sa. Again, the extremely critical response was not overwhelmingly endorsed, but 
about a quarter of the physicians and a^fifth of the AHPs did so. ^ 

B.^ "Before** Assessmeint of MHMOP Central Office Staff " ' . 

The MHMOP Central Office Htaff wSiB asked for its attitudes by requesting their prediction of 
response distributiops. This would reflect their assessment of PCU staffs' knowledge and attitudes, in 
short their image of P(-U personnel. 



Table 7 

ATTITUDES TOWARDS MHMOP CENTRAL OFFICE'S HANDLING oV 
ENROLLEES" COMPLAINTS, BY PCU PHYSICIANS 
AND ALLIED HEALTH PERSONNEL ( AHP) 

Q. IVB: "In regard to complaints by patients: iCHECK,ONE)"* 



, ' ' 1 

Response 


Total 
(N-32) 
Percent^ 


M.D.s 
(N=9) 
Percent' 


AHP 

(N--23) 
Percent' 


The MHMOP Central Office always 
takes the patient's side, 
doesn't listen to reason. 








The MHMOP Central Office seems 
r to make reasonable evaluations 
of complaints and call^^ to our 
attention usually only those 
where a problem does exist. 


• 

47 


23 


65 


It is hard to say: sometimes 
the MHMOP Central Office seems 
to take sides, other times it 
seems to be reasonable. , 


37 


61 


18 


No Answer, More than 1 answer. 


16 


15 


18 


Total 


100 


99 


101 



'Rounded, may add to 99^^ or lOl'? 



*See Appx^ndix 2 for text of Q IVB 
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Table 8 



ATTITUDES TOWARDS MHMOP CENTRAL OFFICE'S MARKETING 
* PRACTICES AND EXPLANATIONS ABOUT BENEFIT 
' PACKAGE, BY PCU PHYSICIANS AND 
ALLIED HEALTH PERSONNEL (AHP) 

Q V: "Please check the one statement that most closely reflects your experience in regard to 
Enrollment:"* 



Response 



! The people at the MHMOP Central 
j Office who enroll new members 
either don't know about the 
services that are covered or 
• *else they deliberately exag- 
; derate just to "make p sale," 
i because most new enrol lees 
i demand much more than they, are 
entitled to. 

Some new enrol lees don't seem 
to know what joining MHMOP 
means and what they are 
entitled to^ but some new . 
enrollees do know fairly 
accurately. 

Most the time, new enrollees 
know what they are entitled to 
and what enrolling means. 

Xo answer, More th^ 1 answer. 

Total 



H..unf^'(i. mav add Ui and 101'^ 
'^vi- Xpp^-ndix 2 U)V text of Q V 



Total 
(N = 32) 
Percent ' 



20 



53 

10 
17 



100 



M.D.s 
(N=9)' 
Percent ' 



23 



38 

23 
16 



100 



AHP 
(N=23) 
Percent ' 



18 



65 



101 



t 

I 
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Thene projectioriH are presented in relation to the actual distributions obtained from the PCU 
questionnaires. The Central Office staff were asked to predict for four groups bf PCU staff: (1) 
sDhysicians; (2) personnel with patient contact;. -(3) administrative and clerical personnel; and (4) 
technical staff. 

Table 9 shows the data for these projections. The grouping for the percentages mentioned by the 
Central Office staff are very large, but they are designed to point out 1007^, 5Q9( and (y/( answers. 
The eight Central Office j-espondents all felt that all (10(W) the physicians would know that the 
administration department exists. For the three groups of AHP shown, fewer felt that all (100^;^) 
knew of this department, narrtely 6, 7 and 6 for the three groups respectively. In fact, 89^;^ of the 
physicians and S37( of the AHP were correctly informed. 

C)n the whole. Central Staff overestimated the knowledge of the PCU physicians. This is 
particularly striking for marketing and finance. Not shown in Table 9 is the finding that for systenzs, 
onv Central Qffice respondent came within W/( of the actual percentage of informed physicians and 
two came within IO^y for Health Education. In all other cases, no one from Central Office came 
within KXr of the observed percentage. 

The picture for the AHFs is not much different, insofar as accuracy of prediction is concerned. It 
Is interesting to note that the ('entral Office staff sees physicians as better informed than AHP with 
two exceptions. 3 Central Office staff believed that KKXr of the office personnel knew of the Systems 
department, while only two thought all physicians knew of it. The Medical Records department was 
believed to he universally known 'by office and technical personnel, by four and three Central Office 
members v\:hile only two each thought so of physicians and nurses. Five Central Office staff believed 
KKKf of patie^^nts contact personnel knew about the Operations department, while only two believed 
this of physicians Finally, and perhaps most astonishingly, the Central Office staffs perception of 
A HP's acquaintance with Health Services, '\n particular with regard to the patient contact personnel: 
s'ix Central Office staff envisage below 50 percent awareness(()f this department and two of these feel 
none are aware of its existence. 
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Table 9 



CENTRAL OFFICE STAFF (COS) PREDICTIONS OF PRa'f'ORTIONS ' 
OF PCU PERSONNEL WHO KNOW THAT SPECIFIC DEPARTMENT EXISTS * 



Number of COS Predicting Specific Percentage to Indicate What Proportion of PCU Personnel 
Knows About Department. I N = 8).** . 



PREDICTIONS PREDICTIONS PREDICTIONS PREHlCTltf>NS 
FOR M.t).s FOR PCP' FOR OP^ FQF^^ 

■ • ABMINISTRATION 




8 


io(y/( 


6 


' 1007r 


7 




6 


1009^r 




95-557r 






1 


95-55^/f 


1 








9 


OU Vr 






1 
i 


OU A 


— 






45-57r 


— 


45-57r 




45-57r 








CK/r 










Actual who knew 










'839r^ 






' 6 


iOOVr 


2 


MARKE 

lOCK/r * 


TING 
2 


io(r/r 


2 


lOCK/r 






2 




4 


95-55^/t 


1 


ri c c tact 


1 




2 






507r 


2 


5W< . 






1 


45^5'}^ 


1 




2 


45-5^/r 


1 
1 


KJ Y 


1 






yj n 


1 
1 




Actual who knew 
















/• 






PUBLIC RI 


:lat 


IONS 






\. 2 










lOCK/r 




io(y/r 


3 




2 




3- 


95-55'/r 


1 




1 




1 


5(r/r 


2 


5(y7f ^ 






2 




3 


45-5^/r 


2 


45-5'7r ^ 


4 


45-57r 






2 




1 




3 




Actual who knew 
















' » — ^ 






SYSTEMS 








2 






lOO^r 


3 ' 


I007r 


1 


lOCK^ 


/ 1 




1 


95-55^ 


2 


95-557r 


n 


95-557r 










5(r/r 




5(y7r 


2 


45-5^ 


4 


45-5^/r 


3 


45-57r 


5 


45-m 














2 




Actual who knew 
















^PCP - Patient ('ontact Per{w)nnel - RN. I.PN. Medital AsniM 


or Aid«, 


Receptionist. 










*C)P - ^)frjce Personnel ^ Administrator, Admjn 


Asst & other 


office and clerical 










'TP - Technical Personnel ^ Medical Records, Laboratory 








ft 






^This percent is for all AHP cotnbmed — breakdown into, 3 
clansification 


groups 


not possible since 


too many respondents failed to 


indicate thtir job 



* See Appendix 2 for'text of Q.I 

**Some a)iumns do not sum to 8 because of missing responses 
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. ^ ^ ^ . 

Number of COS Predicting Specific Percentage to Indicate What Proportion of P('U Personnel 
Knows About Department. (N = 8) 

PREDICTIONS PREDICTIONS PREDICTTONS PREDICTIONS 
FOR M.D.s FOR PCP^ FOR OP FOR.TP^ 

, J : - 

MEDICAL EECORDS 



Actual who knew 



















2 


um 


2 




4 


io(y/< 


3 




6 




5 




3 




3 






















•45-5^^ 


*1 




1 




1 
















1 






' B7^Y 















Actual who knew 







2 


lOO^f 


7 




3 


10(K/r 




95-55^Y 


5 


95-55V, 


1 


95-55V, 


4 


95-55V, 












50^/. 








45-5^^r 


1 


45-5^f 




45-5^/^ 


1 


45-5V, 












(y/< 


























* 


OPERi 




NS 






2 




5 


io(y/r 


2 


iO{y/< ^ 






4 


95-5.W 


2 


95-55^^r 


3 




^1 


95-55^^. 


1 




1 ' 








3 




I 


45-5^^r 






2 


45-5^/r 


3 


45-5iK 












0'y< 


1 





Actual ^( who knew 



HEALTH SERVICES* 



4 








1 


io(y/r 


1 


10(M 


2 




'1 


95-557r 


4 


95-55Vr 


2 


95J5 


' I 


50^ 


1 




1 




1 


504 




45-5^t 


4 


45-.W 


2 


45-5^/r 


2 


45-5^ 














I 


{Y( 



Actual who knew^ 



* PCP Patient Contact Personnri - RN, I.PN, Medical AsRiflt or Aide, Receptionists 
' OP Office Pernhnnel - Admin istrat/iti. Admin AsHt.^it other ofTice and clerical 
' TP ^ Technical Personnel - Medical Record.s, J^boratory 

•* Thi« percent w ff)r all AHP combined breakdown into '\ groups not possible mnce too many respondents failH to indicate their Job 

ciaHHification i \ " 

**Some columns do not sum to H because of misfting\spf)nHes , / i > 




TABLE 9 (Continued) 



Number of COS Predicting Specific Percentage to Indicate What PropoHion of PCU Personnel 
Knows About Department. (N=8)*'^ 

\ PREDICTION^ PREDICTIONS PREDICTIONS ^REDICTIONS 

\ ' FOR M.D.8 >. FOR PCF FOR OP^ FOR TP^ 

' : '. > m • 

IIEALTH EDUCATION 



2 


lOO^r 








100% 




100% 


2 ' 


95-557^ 


1 


95-55^r 


4 


95-55% 


1 


95-55% 








507c \ 




50% ^ 


1 


50% 


a 


45-5<7r 


5 




4 


45-5% 


5 - 


45-5% 






1 






0% 


1 


0% 


^ who knew 










61%^ 







'H P PatU'nt ( ontucl Ferwjnnel - RN. l^PN, Medical Amimt or Aids, Receptionist 
^OP OfTjc** Per*U)nnej Ad mmmtfut4)r. Admin Amt fit other ofTice and clerical 
'TP Technical Perw>nnel Medical Records, I^ahoratory 

♦ThiH percent im for all AHP comhined breakdown into 3 f^roups not posHible Qince too many respondenta failed to indicate their johN 
claHhjfjcution 

*^.Some columnM do not num to H h«'cauKe of mmmnK reHponseH 




\ 



\ 



\ 




\ 

\ 

\ 
26 
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Perception of PCU physicians knowledge about HMO terms and operating principles (Question II 
A-E) will be presented in ferms of the number of Central Office predicting the proportions of correct 
answers given by the physicians. It will be recalled from Table 3 that knowledge was found to be 
quite limited. The staffs perception of physician knowledge was much larger than the actual findings. 
Only six respondents completed Question II. Table 10 shows the data for Physicians. Only for one 
item, Fee-for-Service, did one Central Office member predict accurately within I07c for physician 
knowledge. 

-Table 10 shows comparable data for the predictions for AHPs knowledge about HMOs. Office 
Personnel (OP) are perceived as knowledgeable ^s physicians. Patient Care Personnel (FCP) and 
Technical Personnel (TP) ar« pi^eeeived as less kaowledgeable. Consequently, OP was overrated and 
the other two AHP groups were perteived more realistically; 

It was not possible to compare projections by Central Office staff for Questions III, the provision 
of specific services. The correct answers by PCU personnel depended on the nature of the. PCU in 
which they work and the type of contract that the PCU^has with MHMOP. The single projectio^is by 
the staff do not take this into consideration, and comparisons "are invalid. - 

^^fj^^ \ THe comparison.^ of Central Office staff predictions for Questions III (second part), the ways of 
obtaining information about service requests, show none of them approaching the actual distribution 
found and shown in Table 5. The only congruence observed is that Centrafl Officest^ff does notion 
the whole, visualize PCU staffs using written materials for obtaining information. Table 11 shows the 
data for this comparison. v 

Central Office staff, on the # whole, also believe ttfat most PCU staff perceive MHMOP as 
reasonable somefimes and not reasonable other time.s in approaching PCUs wUh enrollee service 
requests. About 61 percent of the PCU physicians did select this- response. The AHPs, 59 p|prcent, 
reported a more benign attitude and selected the response indicating that MHMOP usually is 
justified when it intervenes with such requests. Table 12 presents this data. 

Central Office staff sees PCU physicians as more understanding in regard to handling patient 

^ complaints than distribution of physician answers indicate. Half the Central Office staff see AHPs as 
understanding, half see them as less understanding of the Central Office. Table 13 shows this data 
for Questions IVB. 
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Table 10 



„ CENTRAL OFFICE STAFF ((lOS) PREDICTIONS OF PROPORTION OF 
PCU PERSOi&NEL WHO KNOW THE CORRECT ANSWERS TO HMO FEATURES* 



Number of COS Predicting Speciric/' Percentage to Indicate What Proportion of PCU Personnel 
Knows HMO Feature Correctly. (N = 6.)** 

• o - * 

PREDICTIONS -PREDICTIONS PREDICTIONS PREDICTIONS 
FORM.D.s FOR PGP FOR OF* FORTF' 



CAPITATION 







3 




1 


507c 


2 


1007c 


1 


\007c 






1 


257r 


1 


307c 


\ 1 


909c 


2 








2 




1 


207c 




207c 


1 












1 


\07c 


^2 




2 










- 


2 


07c 




/ 






Actual % 


who kne^ 




447c 






If 


, 227c ^ 




































FEE-FORSERVICE 






















V 




- 




2 


1007f * 


1 


707( 


1 


.1007r 


1 


9Wc 






- 1- 




1 


607c 


2 


907?^ 


1 


607c 






1 


sm 


1 


337c 


3 


80'7f 


1 


337c 






1 




2 


207c 






1 


207c 






1 




1 


07c 






2 




Actual *i 


who knew 








4 




357^4 












f 




. ^ISK SCARING 










3 




1 


607c 


1 


\007c 


1 


337c 






1 


S07c 


1 


337c 


2 


907c 


1 


307c 






. 1 






307c , 


2 


%07c 


1 


I07c 






1 


207c 


3 


07c 


1 


2m 


3 


07c 


Actual 7( 


who knew 




677c 















Actual 



knew 



BENEFIT PACKAGE 



1 


1007f 


1 S07c 


1 


907c 


1 607c 


2 


S07c 


1 33^f 


2 


20^/c 


1 307c 






1 207c 






1 07c 



1 

2 
3 



100^ 
907c 
80% 



447c 



b07c 
337c 
307c 
207c 
\07c 



'POP - Patient ConUct Personnel = RN. LPN, Medical A8Si8t. or Aide, Receptionist. 
^OP - Offioe Personnel = Administrator, Admin. Aisst. & other office and clericjil. 
1TP - Technical Personnel ^ Medical Records, Laboratory 

^This percent la for al! AHP combined — breakdown into 3 groups not posnible since too many respondents failed to indicate their job 
classification 



\ ^S^e ApwndiK 2 for text of Q. 11 A-E. 

^ wipe «o lump fl do not sum to 6 becauRe of missing responses. 
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Table 10 iContinued) 



I Number of COS Predicting Specific Percentage to Indicate What Proportion of PC\J personnel 

i Knows HMO Feature Correctly. ( N-6) ** 

' i 

\ PREDICTIONS PREDICTIONS PREDITIONS PREDICTIONS* 

; • ^ FOR M.D.H .FORPCP* FOR OP^ FOR TP'* ' 



SPECIALISTS REFERRAL 



Actual ^( who knew 



1 


10(FT 


1 


4(K? 


2 




2 




1 


:}(¥( 


3 


{¥'< 


1 


2iy< 






1 


{¥'< 








56^ r 







1 


100^ 


1 


3m 


1 




2 




2 


HOT 


3 


{¥/< 


1 








1 










4:v^< 







■!*( V I'.itH'fil ( unt.Ht Prrs(jnn<*l RN, IJ'N, MtHiual AsMiMt or Aulf, Hetepti(jni>^t 

-'Of Ofluf IVrsonncI Adrmnirtlrator Adniin A>»M)Ht & nther ofTife and ( Ifrira! 

'TP IVihnuai Personnel Mwiital Rftords, l^iboraturv » 

^Th1«« percent i-. tor all AMI* (f)mb)n('<l brtMikciown intn 1 ^idupr^ nut [Kjssible Hinrt* 1(m> many respondents lailed to indicate their joh 
I las?.iru .It ion 

**Sjme t ohunn'' di* not ^\m\ to H heoiu^* o( mishin^i responses 
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99 
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CENTRAL OFFICE STAFF (COS) PREDICTIOT 
PCU PERSONNEL WHO SELECTED A 
^ - CATEGORY FOR Q. IIP 



PROPORTION OF 
RESPONSE 



Number of COS Predicting Specific Percentage to Indicate What Propb|:|ion of PCU Personnel 
Gave a Specific. Answer N~7)** 



Actual who gave 
this response 



Actual who gave 
this response. 



Actual who gave 
this response 



PREDICTIONS PREDICTIONS PREDICTIONS 
FOR M,D.8 Fffl PCPi FOR OP 




EDICTIONS 
OR TP3 



Response: ''Refer to Written Materii^^*^ 



2m 



5(r/f 



\ 



\ 

\ 

2m. \ 



\ 



\ 



m 



12'7r' 



Response: **Coneu|t With Someone In Office" 



, • 1 


lOO^f 


1 lomc 


\, 1 




2 


1007f 


i \ 


bm 


1 807f 


1 




1 


im 


t 




1 bm< 


1 


5W 


1 


6(y7f 


1 . 




1 25^r 






1 




1 




1 2mc 






1 


\m< 



Am 



Response: "Call Up MHMOP Central Office 



1 907f 
1 SCK/r 
1 3(y7r 



lOO^r 
6(y7r 

207r 



95% 
40% 
20% 



.1007^ 

ro% 




Response: "Already Know Answer -Because 
I JHave Been Doing This So Long" 





21 


100% 


3 ; 


50% 


1 


80% 


1 


60% 




1 


70% 


1 


40% 


1 " 


20% 


1 


40% 




1 


50% 


1 


10% 






1 


10% 




1 , 


20% 














Actual % who gave 


V 
















this response 




15% 








29% 5 








- ipCP Patient (k)ntact Personnel ^ RN, LFN, Medical Asflist, or Aide, Receptionist 
'OP- Office Personnel - Administrator, Admin Asst. fit other office and clerical 

iXP - Technical Personnel - Medical Records, Laboratory ^ f 

*For OP« only 5 Reapondsnto 

*Thm percent m for all AHP combined — breakdown mto 3 groups not possible since too many respondent* failed to indicate their job 
classification 



•Sw Appi»ndi)c 2 for tent Q HI 
Q Some columns dp not sum to 7 because of missing responses 
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Table 12 

CENTRAL OFFICB STAFF (COS) PREDICTIONS OF PROPORTION OF 
PCU PERSONNEL WHO SELECTED A GIVEN RESPONSE 
CATEGORY FOR Q. IV A* 



Number of COS Predicting Specific Pe rentage td Indicate What Propbrtion o'f PCU Persbnnel 
tJave a Spe-dfic Answer."^TN=Tr.'^ " • " " ' — * " ' ~" ^ " ^ 



PREDICTIONS PREDICTIONS PREDICTIONS PREDICTIONS 
FORM.D.s FORPCF FOR OP^ FOR TP^ 



Response: "MHMOP COS Unreasoeable, Makes Waves'* 

2m 2 2m 1 2(y7.'* 3 



2 

1 



2m 



■ Actual who gave 
I ' thirt response 



87. 



Response: ••MHMOP COS Usually Reasonable", 



1 


1007. 


2 


1007 


2 


1007^ 


3 


100^/. 


2 




2 


407 


1 


907 ^ 


1 


507 


1 


^m 


1 


207 


1 


507 


2 


20^/. 










1 


207 







Actual who gave 
thivS response 



237 



59^/. 



Response: "MHMOP COS Sometimes Reasonable, Sometimes Not" 



1007 
50^/. 
40^/. 



1007 
607 
557 
407 



I Actual 7 who gave 
I this response 



617 



957 
507 
607 
107 



297 



100^/. 

•907* 
607 
407 
307 



Putirnt Contact Personnrl RN. LPNVMedical Awist or Aide. Receptionist. 
^OP Office Pet^innel ■ Administrator. Admin. Awt. & other office and clerical, 

'TP Technical Personnel ^ Medical Records. Laboratory ^ 

^For OP'?} only 5 Res^ndents r , . . l • u 

^Thi« percent i» for all AHP combined — breakdown into 3 groups not possible since too many respondents failed to indicate their job 

claflHification 



*See Appendix 2 for text of Q JVA 

Some columns do not sum to 7 %cause of misHing responses. 
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Table 13 



CENTRAL OFFICE STAFF (COS) PREDICTIONS OF PROPORTION OF 
FCU PERSONNEL WHO SELECTED A GIVEN RESPONSE ' 
CATEGORY FOR Q. IVB* 



J 



Number of COS Predicting Specific Percentage to Indicate What Proportion 
Gave a Specific Answer. {N=7).** 


of PCU Personnel 


i 
i 


PREDICTIONS • 
FOR M.D.s 


PREDICTIONS 
FOR PCP^ 


PREDICTIONS 
FOR 0P2 


PREDICTIONS 
FOR TP3 


! ■ ■ 

1 




Regpoose: "MHMt)P Ah 


vays Takes Patient's Side" 


1 


1 




2 209c 
1 I07c 


1 207c'' 


3 20% . 


j 

Actual who gave 
this response 








07c^ 








Response: 


"MHMOP Makes Reasonable Evaluations" 


i 

i 


3 

1 
1 

1 

1 


1007r 
807r 

2Wi 


3 1009c V 
1 ' 607c 
1 46^ 
1 303/ 


2 1007c 

1 907r 

1 507c 
1 207c 


3 100% 
1 50% 

1 - --407c 
1 20% 


Actual ^'t who gave 
1 this response 

■" — ^ 




237c 




e57c^ 








Response: 


"MHJVIOP COS Sometimes Takes Sides," 
Sometimes Reasonable 




1 
1 
1 
1 


907c 
S07c 
507c 
207c 


1 1007c 
1 607c 
1 507c 
1 407c 
1 307c 


1 95% 4 
1 60% 
1 207c 
1 10% 


1 100% 
1 90% 
1 60% 
1 50% 
1 30% 


Actual % who gave 
this response 




6l7c 




18%5 





ip('F Patient Contact Personnel ^ RN, LPN, ^^^cal Assist, or Aide. Receptionist. 
^()P Office Personnel - Adminifltrator. Admin. Asst & other office and clerical. 
TP Technical Personnel ^ Medical Records, Laboratory % 
*hor ()V*n only 5 Renpondents 

Thm percent is fat all AHP combined — breakdown into 3 groupa not possible since too many respondents failed to indicate their job 
classification 

* AppendiTi 2 for text of Q IVB. 

**Some columns do not sum to 7 because of missing responses. 
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The final comparison, the perception of PCU staff assessmetjt of the problems with the Benefit 
Package is presented in Table 14. More hostjffity towards the marj^ting personnel was expected by 
Central Office staff than was actually found for either the physicik^s^r the AHP. Central Office 
staff, however, did not expect many PCU staff to feel that enrollees or^i^e whole are well informed. 
Table 14 shows the comparisons for Question V. \\ 

O. "Your Opimiioin Please'* 

This brief questionnaire, reproduced in Appendix 7, was completed by persons attending the Ann 
Arbor session of the training. Question I asked for evaluation of the information presented during the 
training session along four dimensions. Critical responses such as: too much, not enough, not helpful 
at all, confusing^ boring in every instance, represented a minority opinion. Table 15 contains the data 
for this question. 

Participants were asked to select the one presentation they liked best and the one liked least. 
Question 2 provided a total listing of the 15 presentations. However, physicians attended only 9 of . 
these, while AHP attended 12. The rankings of presentations has been presented in two versions. 
One, Table 16A shows the rankings of the six presentations shared by all p^icipants. The second. 
Table 16B, shows rankings of nine sessiohs by physicians and twelve sessions by AHP. The best liked 
was Patients Rights, the Marketing presentation (item f) was the least liked by physicians and nurses, 
while the remaining AHP agreed on What is an HMO^ (item a). Perhaps as significant as the, 
identification of best and least liked presentations, is the finding that many tewer persons indicated a 
"least'* liked choice than a "best liked" choice. Twenty-three made no adverse selections, while six 
failed to identify a "best liked" presentation. The rpJaUonship between "best" and "least" liked 
speeches does not appear t6 be direct. Overall, it would seem that presentations about subjects like 
Forms (items k* and k^) are the least popular for AHP, while physicians liked Medical Topics but did 
not care much one way or another about Future Plans Relating to Dental Care. It is impossible to 
attribute the reasons for these likes and dislikes since no information about them was collected, but 
-undoubtedly the content of the presentations was not the only factor considered when^'mal^Tng choices. 

The comments made were generally brief and limited to naniip^^eas of concern for MHMOP 
development. Some comments were critical and some compleme^^^. Generally there was diversity 
of opinion: one respondent would eliminate discussion of en^iint^r forms, another wished to hear 
more on that topic. (Table 17). // > 

Assessment of PCUs. ^'^ . ^ 

The questionnaire used for the data collection afte^ the training session was, as mentioned 



previously, an adaptation of the initial MIS instrupent,|rhe adaptations consisted of the following: 

1. A physician and AHP version wepfe d^ised. The physician questionnaire contained 
previous questions on HMO terms dnd organizational principles in identical format. The 
AHP version omitted this group of i^fnS; it was felt, by MHMOP, that AHP do not 
require a knowledge of these aspect an4 had not been present at some of the presentations . 
delving intp such topics. . /^^ 

0 2. The former Question III, relating! provision^ services, was redesigned in view of its 
format and coding complexity. ThVfratee of i^re^ence w^s shifted to inclusion of items in^ 
the basic Benefit Package, i.e., avjsi|bility if ordered by a physician or absolute exclusion. 
A few items were dropped. f 

3. Reworking of previous Questioij V^jenrollee expectations, into a new Question IIB. 

4. New questions stemming from f|iaterial covered by the training session but of basic 
concern or strong current cone0ri|)'as observed during the needs assessment. Questions III, 

IV and V of new version. If 

m 



ERIC 



The revised instruments are shown in ^PliO^^ices 7 and 8. 

The questions relating to knowledge .|i)out HMO characteristics. Question I for physicians,, will 
be presented' first. Table 18 shows the Te^|ilts of the "Before" questionnaire (administered prior to the 
Ann A rbor c onference) and^those for th||'^Augult conference held in Detroit. It will be recalled that 
some jJersons attended this meeting fVQ^nhough they ha d n ot participated in the Ann Arbor session. 
As lypfeviously discussed, theNdgnifi^ii^ of the observed improvement for the pure "Before" group 
and the "After Ann Arbor" group r^^if on very few cases. A comparison with the few cases in the 
"Not at Ann Arbor" group illustrated t^te softness of the data. ^ 

^- . - ic, 

/ 33 
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Table 14 



CENTRAL OFFICE STAFF (COS) PREDICTIONS OF PROPORTION OF 
PCU PERSONNEL WHO SELECTED A GIVEN RESPONSE 
CATEGORY FOk Q. V* 



Number of COS Predicting Specific Percentage to Indicate What Proportion of PCU Personnel 
(lave a Specific Answer. (N^7).** 



' <i 



Actual who gave 
this response 



PREDICTIONS PREDICTIONS PREDICTIONS PREDICTIONS 
FOR M.D.s FOR PCP FOR OP^ FOR TP^ 

/ 

RespoDise: "MHMOP Don't Know or Exaggerate/'To Make Sale" 



4m 



4m 

\m 



Actual who gave 
this response 



Actual who gave 
this response 



se: "Some New Eerollees Doig't Know 
What Jomiimg Meams, Some Know 
Fairly Accurately" 



3 
1 
2 



lom 


4 


lom 


2 




3 






1 


im 


2 


• 9m< 


1 


5m< 


6m 


1. 


5m 


1 


4mc 


1 


3m 




1 


40^:^ 






1 


207. 



657, s 



r 



nse: *'Mo§t of the Time, Ne,w Enrollees 
Know What They Are Entitled To'' 



im 



23^/r 



2m 



20*'* 
107. 



2 

1 



207 
107 



'P{'P Patient (\)nta(^ Personnel - RN, LPN, Medical AhrisI or Aide. Receptionist 
^()P - OfTice Personnel - Administrator, Admin, Asflt 4t otiier office anticlerical 
'TP Technical Perwnnel - Medical Records, I>aborat/)rv 
*F"or ()p'H Only 5 IRespondents 

^Thw percent ih for all AHP combined — breakdown into 3 (groups not poMible since too many Vespondents failed to indicate their job 
claHfiification 

*See appendix 2 for text of Q V 

**Some columns do not sum to 7 because of misjiing reRpon.ies > 




Table 15 



I 



PARTICIPANTS' EVALUATION OF INFORMATION 
PRESENTED AT TRAINING SESSION 



% I.; ' 


The information given 


during the conference was: 




H 







~ - — - 


" ' Totaf 


" "m:d;s"' 




OtTier^HPS 




Responses 


{N=68) 


(N=10) 


(^-21) 


,(N=37) 






Percent ^ 


Percent^ 


Percent^ 


Percent^ 


a. 


Too much 


y 




y 


1 1 




Tax. i- Dl^l^i- 

Just Kight 


e.o 




oz 


o*t 




Not Enough 


19 


30 


9 


22 




No Answer 


1§^ 




29 


.13 




Total 


100 


100 


99 


100 


L 

b. 


Very Helpiul 


oy 


7n * 
/u 


*to 






bomewhat Helpiul 






OO 






Not Helpful At All 




10 


5 


11 


• 


No Answer 


6 




9 


5 

« 




Total 


100 


100 


100 


100 


c. 


Very Clear 


OK 
OO 


on 








i)kay 






1 4. 


OO 




v^oiiiusing 


12 




19 


11 




No An-^wer 


19 . 


20 


33 , 


. 11 


* 


Total 


100 


100 


99 


100 


d. 


Interesting 


71 


70 


67 


73 




Alright 


13 


20 


5 


16 




Boring 


7 




9" 


8 


j 


No Answer 


9 


10 


19 


3 




Total 


' • 100 


100 


100 


100 


i 













'pep Patient Care Prrsonpel : RN, LPN, Medical Assistant or Aide, Receptionist 
•^AHP Aihed Health Personnel 
•Hounded, may add to 99^^ or lOr^ . 

*Se** Appendix 7 for text of J ^ ' 
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Table 16A 




RANKING OF PRE;fiENTATION AS BEST LIKED AND. LEAST LIKED 
FOR 6 TCTPICS ATTENDED BY ALL PARTICIPANTS 

Q. 2.: "Put. a check mark by tj^e one presentation you liked best in Column A and a check mark by 
the one presentation you liked least in Column B."* 











bankings of Presentations 

— ^ 








Best Liked by 




Least Liked By 




Presentation 


M.D.s 

(N-10) 


PCP' 

(N-21 


) 


other 
AHF* 

(N=37) 


M.JJ.S 

(N-10 


) 


PCP' 

(N=:21) 


Other 
AHP2 - 

(N=37) 




"What IS an HMO?" 


2 


3 




f— 

2 


Q 

o 




4 


1 


[) 


rat Jen t Kij^nts 


1 


1 




1 


' 5 




2 


5 


C. 
I 


"How Michigan HMO 
Plan's, Inc. Operates*' 


4 






6 


5 




: 6 


3.5 


d. 

i 
i 


'\ 

"Health Services 
Available via MHMOP 
Central Office > 
Referral"- 


5 


' 4 




5 ^ 


5 




5., 


' 3.5 


e. 


" Fee-for-Ser vice 
. Utilization" 


3 


'6 




4 


2 




3 


2 


f. 


How Michigan HMO 
Plan is Marketed" 


6 






3 


1 




1 


-6 . 


Number Not Answering 


(1) 


(-) 


(5) 


(4)' 


(5) 


(14) 



1 PCP Patient Care Personnel RN. I.PN, Medical AH«i8tanlor Aide. ReceptioniHt 
^AHP ' Alhed Health Pernonnel 

*Si»e Appendix 7. for text f)f 2 
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Table, 16B 



RANKING OF PRESENTATIONS AS BEST LIKED^ AND LEAST LIKED 
FOh^ ATTENDED BY I>HYSICIANS AND 12 ATTENDED 

BY ALLIED HEALTH PERSONNEL (AHPf ' ^ 



Rankmg of Presentations 



By M.D.s* 



(N = 10) ' 
Best Least 



By PCP 



, (N = 21) 
Best Least 



By Other 




a. 

b. 
c. 



ki 
k2 




"What IS an HMO?" 

"Patient Rights" 

"How Michigan HMO^ 
P^ns, Inc. Operates" 

"Health Services , 
Available via MHf 
Central Office 

"Fee-for-Service 
Utilization" 

"How Michigan HMO 
Plan is Marketed" 

"Financial structure 
of thi^ Plan" 

Effective Patient 
Management" 

"Corporate Dental 
Planning for MHMOP" 

"Account Executives" 

"Enrollee Orientation" 

"MHMOPs HOTLINE" 

"Enrollee Concerns" 

"Medical Records" 

"MHMOPs Encounter 
Form" 

Number Not Ans\^^ering 



7 
5 
8 
4 
J3 
9 



(1) 




11 

■ 8 
4 
10 
7 

12 



(5) 




3 

(5) 



1 
5 

3.5 

3.5 
2 
6 



9/ 
8 
11 
7 

10 




'P(*P Patient Carp Personnel RN, LPN. Medical Asflistant or Aide, Receptionist 
*Hee Appendix 7 / 
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' - • , Table i? ' 

PARTICIPANTS' OPINIONS ABOUT INCLUSIONS 
AND EXCLUSIONS OF- TOPICS 

Q. 3.: "Is there. any topic or subject that was not covered that you think should have been covered? If • . 
- YES. describe TOPIC.'** " . ' >• , - ' ' 

. Q 4.: "Is there any topic or .subject that waa covered whicli could have been left out? If YES, describe 
> TOPIC."* " - 















Total 


m;i).s 


PCP^ 


Other AHP2 








(N=21) 


(N==37) 




Percent ^ 


Percent 


Percent 

* 


' Percent ^ 

— -^--j- 


. -- - - - ^ 










Vould have included 










. /additional topids) 










1 ' . ■ • .Yes 


21 


* '30 


19 


19 


;•■ No- 


'48 


^ ,60 


, 57 


40 


j V No Answer 


. 31- 


10 


24 


' *-40 


' • ; Total 


100 


100 


100 


99 












Could have omitted ^ ' 










^ sojpe topics! s) ' 










; - ■ . . . „ ^yeH- 




^ ,10 


14 


- 11 


' No- 


57 


. " 60 


67 


' 51.-: ■■' 


No Answer 


. .. ''31 




19 




' ' \ ' Total 


»■ . . / 
^^^^^ ' 


log 


>• 

J 100. 


V .100 













\ 



•WP Patient Contacl Personnef RN, LPN, Medical Afisiatant'V Afde, Receptionittt 
^AHP Allied Hralth Perftfmnel 
iRi)UtKi«l -fwav add to 99^? or 101'? 



Hi5»pita1 C^re. "Marketing" procedureo. Phyflician^on^Pcf^flnnel rightfl, Encoilnter Form^, Fi* 
ion, HMO, Patient Rtghtw.-' Enrollee (jeieutatteir Accepliince of Provider (Jroup - ''^ 



Hu{;^eotibnn for mcluniotfh Outreach, Pharmacy. 

nanoal hurden of hoHpital over utilisation ^, . iZ.^^-.^-^r-r'-''-^ — 

HufjgeHtiona for omminoionR: MarlietinK, "mwt oFjjXA^f^^dtcai Rf^cOTdtTTHiTWhole Thiri^ Encounter Ti^jTtnfl. Referral Det,4iil8 
(ienerQl CommenU}: iQ 6> (^onsumer. fililreacK, Reveipal complimentn. should he repeated every four ipi^nthu" 



*!;^ Appendix ' 




•• 'Table 18 

PCU PHYSICIANS ANSWERING QUESTIONS ON HMO FEATURES 
CORRECTLY* BEFORE AND ATTER TRAINING.SI?;S5ri(W.,Q.I ** 



HMO Feature ^ 


PCU Physicians Answering Correctly* , 


Before 
Training (A) 

(N=9) 
. Percent 


After" 
Training (B) 
(N=7) 
Percent 


Not 
Trained (C) 
(N=5) 
Percent 


A and C 

(N=14) 
Percent - 


Capitatiiln 


44 


• 100 


100 


64 ■ 


Fee-for-Service 


44- 


71 


100 , 


64 


Risk Sharing 


67 


100 


100 


. ' 79 


Benefit Package 


44 


57 


60 


50 


Specialist Referrals 


4 


71 


80 


64 



4 



A Data from questionnaire administered before Need^ Assessment. 
B Data from PhyHicians attending Ann Arbor Training Session., 

r Data from Physicians NOT attending Ann Arbor Training Session but attending August -Gth Session. 
(*Drrect Responses: QIA., QIB2.. QIC^., QIDL. QIE4. y 
**See Appendix 8 for text of QIA-E ( Physician Version) * 
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Nevertheless, since the data all go in one direction, some impact appears to tis^ye been made by the 
training sessions. . \ ^ 

Questions IIA assesses PCU staffs' knowledge about the availability of an array of services. The 
question was scored for each individual respondent, possible scores ranging up to 2^. After some 
scoring had been done, it became clear that some respondents frequently checked rnS^ than one 
answer per service, and it became necessary to score by deducting **wrong" answers. Tm^ in turn, 
xreated the possibility, of obtaining scores^ of less than 0, and such scores have been labeliied 99 to 
distinguish them from 0. 

It was then attempted to score the "Before" question so that scores could be compared, but t'he 
lack of proper identification for relevant items made this impossible. Therefore, Table 19 presents\ 
"After" data only. The overall level of knowledge is not very high: 10 of the 55 from the "At Ann 
Arbor" group, or 18 percent, scored below 0, while the second group contained 37.5 percent of 
negative scorers. Since all negative scorers caTme from AHP and none from among the PCU 
physicians. This may be interpretec^ to show that AHP benefited from the training session in this 
area. The case for the physicians' profiting equalw cannot however be made since the distribution of^ 
Physici^in scores for "trained" and "untrained" respondents shows an essentially similar pattern. The 
score distributions for the two AHP^roups appeartcKdifTer with the untrained respondents clustering^ 
apparently around lower scores. 

The final questions in the revised instrument ^are^ as pointed out previously, not comparable to 
questions in the original questionnaire used for the "before" assessment. However, since both 
"trained' and "untrained" respondents can be identified, comparison between these groups will be 
examined. Table 20 shows Questions IB and Question IP, while Table 21 shows Questions III and 
IV.* ^ • 

Question IB asks about the reason for refusals of enrollees' requests for services. Two answers 
were most frequently chosen: the enroUee's failure . to understand and that no one reason 
predominates. Usually the first reason carries the larger percentage of answers. The *'hostile" 
response thgt MHMOP oversells enrollees occurs more frequently among the "untrteiined" than the 
trained. Again, it is dubious that one may ascribe this small^ difference to participating in the 
training session. 

The second question is a True-False one, asking whetha^ the primary relationship of the enroUee 
is to either MHMOP or a PCU. The correct response, relationship between MHMOP and the enrollee, 
was selected- slightly more frequently by the trained group. Support for this may exist in the finding 
that none of the seven "untrained" selected the correct response. However, the small numbers make 
interpretation precarious. ^ 

Table 21 presents the distribution of attitudes towards the Hot Lftie and about paperwork. 
Question III appears to show more positive opinions- that the Hot Line is a proper Central Office 
function. Among the "trained," interestingly enough, the proportion who do not accept the location of 
the Hot Line in the Central Office is about the same in both trained and untrained groups. The 
number of persons who have "no opinion" is quite different between the two groups with those having 
received training showing fewer in this category, with the difference essentially going to the 
supportive position. If this shift is indeed real, training exposure seems to have had some impiact. 
Opinions about paperwork and its reasonableness perhaps also have undergone a slight mpdification 
towartls acceptance among the trained group. Again, the tenuous character of the data should counsel 
^i^tion in interpretaOon. 



♦QueHtions IB. n. Ill, and IV in the AHI* qurntionnaire are Queationfi IIB, III, IV and V in the Physician questionnaire. 
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Table 19A 



DISTRUBUTION OF SCORES* FOR KNOWLEDGE ABOUT THE 

AVAILABILITY OF SERVICES, BY PCU PERSONNEL 
AFTER TRAINING** AND WITHOUT TRAINING * Q.IIA**** 



Score* 
((Jptimal = ^o) 


After training Session** 


Not At Training Session"^^^ 


Total 


M.D.s 


PCP» 


Other AHF 


Total 


M.D.s 


PCP' 


Other AHP2 


Ljess man u 


10 


_ 


3 


7 


5 


— 


2 


4 


1 

- 1 


3 








3 


» 








— 


9 


2 




1 


1 


2 





1 


1 


o 


7 




5 


2 


1 





1 





A 


5 






5 


_ 











o 


7 


— 


1 


6 




■ — 





— 


o 
















1 


7 


4 






4 


■■■^ 


— 







8 


9 


1 

i. 


1 

i. 




2 






1 


10 


2 




1 


1 










U 


4 


1 


3 




1 








12 


1 






1 










13 


1 


1 














14 ' 


3 


1 




2 


1 








15 


3 


2 


1 












16 










1 








18 


1 


1 














19 










1 








I Total 


55 


7 


16 


32 


16 


5 


4 


7 



\ 



•P(T - Patient Care Personnel ^ RN, LPN, Medical Assist, or Aide, Receptionist. 

^AHP - Allied Health Personnel. ^ ' 

*See text for scoring method . 
"^''After Training" denotes PCU personnel who attended Ann Arbor Training Session. 

***"Not At Training Session," or "Without Training'* denotes PCU Personnel who did NOT attend Ann Arbor Session but attended August 6th 
Se^tsion. 

'"=*^^^^S^Appendix 8 for teirt of Q.IIA (Physician Version). ^* 

r ■ . 




r 




ill 
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Table 19B 

/ KNOWLEDGE ABOUT AVAII^BILITY OF SERVICES "AFTER 
/' TRAINING"* AND "WITHOUT TRAINING"** FOR PCU PHYSICIANS 
AND ALLIED HEALTH PERSONNEL (AHP). Q. IIA*** , 







Percent Answering Correctly 






M.D.8 


•J 


AHP 










After 


Without 

V V 1 LI IWIjI L 




After 


Without 




Il^oalth Services 


Total 


Training^ 


Training** 


Total 


Training* 


Training** 






(N-11) 


(N=6r^ 


^(N=5) 

1) 1 


/ ivi c;q\ 

( IM — oy) 




,( IN — 1 i ) 


1. 


Prenatal Care 


91 


83 


/ 100 


90 


92 


82 


2. 


Eye^ (Jlasse« 


54 


50 


60 


49 


54 


27 


3. 


Plastic Surgery 


18 


17 


20 


29 


31 


J. KJ 




(Cosmetic) 














4. 


Outpatient X-ray 
















Studies 


91 


83 


100 


58 


60 


45 


5. 


EKG & EEG 


91 


83 


100 


85 


87 


73 


6. 


Abortions 


27 


33 


20 


37 


42 


18 


7. 


Dental Care 


45 


50 


40 


25 


29 


9 


8. 


Psychiatric Care 


^ 64 














Outpatient 


.50 


80 


52 


56 


36 


9. 


Contact Lenses 


27 


33 


20 


34 


35 


27 


10. 


Emergency Room 
















Services ^ 


91 


100 


80 


61 


81 


64^ 


11. 


Tubal Ligation 


27 


• 17 


40 


34 


37 


18 


12. 


Inpatient 
















Hospitalization 


82 


100 


60 


78 


81 - 


64 


13. 


Dermatologists 


'45 


67 


20 


42 


• 42 


45 


14. 


Allergists 


54 


87 


40 


44 


46 


36 


15. 


Podiatrist 


45 


50 


40 


36 . 


. 40 


18 


16. 


Health Care 
















(domestic) 


' 36 


33 


40 


27 


25 


36 


17. 


VNA 


45 


50 


40 


OZ 


Q7 




18. 


Psychiatric Care 
















Inpatient 


45 


50 


40 


52 


58 


27 


' 19. 


General Surgery 


82 


67 


100 


78 


83 


54 


20. 


Health Education 


54 


67 


40 


51 


56 


27 


21. 


Prescriptions 


82 


67 


100 


86 


90 


• 73 


22. 


Ambluance 


36 


' 33 




24 ' 


23 


27 


23. 


Transportation 
(other than 
















ambulance) 


27 




60 


"^12 


10 


18 1 



*"Aft*r Training"- Participants at Ann Arbor Session 
**"With()ut training " Participants Dnlv at Au^u-^t fith Session 
•■**Sre appendix H for text of C^. IIA. 
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Table 20 



RESPONSES TO ATTITUDINAL AND FACTUAL QUESTIONS, BY PCU PERSONNEL 
' . "AFTER TRAINING'^ AND "WITHOUT TRAINING.'^'^ Q. IB AND II 

Q. IB: "When you think about enroUee service requests which are not granted, this most often 
happend because: (CHECK ONLY)'^** - ' ' 



Responses ^ 



Total 



After Training Session 



Percent^ 



M.D.s 
(N = 7) 
Percent^ 



PCP» 
(N=16) 
Percent^ 



Other 
AHP2 
(N = 32) 
Percen t^ 



Not At Training Session* 



Total 
(N=16) 
Percent^ 



M.D'.s 
(N-5) 
Percent^ 



PCP> 

(N = 4) 
Percent^ 



AHP2 
(N=7) 
Percent^ 



1. "The enrol lee hasn't 
understood what the 
Plan in fact provides." 

2. "PCU Staff is not 
cortectly and. 
completely informed 
as to the range of ser- 
vices to which the 
enrollee is entitled." 

3. "MHMOP CO has not 
explained the pro- 
visions to the PCU." 

4. "MHMOP CO has 
always oversold the 
enrollee." 



49 



14 



44 



, 59 



50 



20 



50 



71 



29 



25 



'FM'F Patient Care/PrMonnel RN. LPN. Medical Assist, or Aide. Receptionist ^ - 

^AMP Allied Health Perf«)nnel 

^Rounded, may add to 99^^ or lOlT ^ , ' " . 

* At^er Training" denotes KU' personnel who attended Ann Arbor Training Session. V, , * * r» . o 

' Not ;it Training SesHion" or "Without ll-aining denotes PCU PerHonnel who did NOT attend Ann Arbor Sesfiion but attended August 6th ^es- 

>,i(>n 

'**See Appendix 9 for text of Q IB 
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Table 20 (Continued) 





After Traini 


ng Session* 


Not At Training Sessior^ 


Responses 

■ 


Total 
\S' 55) 
f^efcefrt*^ 


M.D.s 

( N-= 7 ) 
Percent**^ 


PCP» 
(N 16) 
Percent ' 


("if K<ir 

AHF^ 

iN-32) 
I^ercent'^' 


Total 
( N ^ 16) 
Percent'' 


M.D.s 
(N = i) 
Pfercent'' 


PCP' 

(N = 4) 

Percent'' 

t 


AHF' 
Percent' 


5. "Some instances of 
each of the above 
reasons, no one 
in particular." 


" ' 27 


* <^ 
' 57 


31 


19 


^ ' _ 

31 






14 


No Answers 


13 




19 


12 ' 


12 




25 


14 


Total 


100 


100 


100 


99 


99' 


100 


100 


99 


Q. II: "Which of the following statements is 




U 

(^HECK ONE OF THE 3 BOXES) 


* 


A. The primary 
contractual 
relationship is 
between the PCU 
and the enrollee 
assigned to it." 
' (FALSE) 


• 

22 


\ 

14 


37 


16 


25 


20 




43 " 


B. 'The primary \ 
contractual ^ 
relationship, 
is between 
MHMOFs 
Central Office and 
the enrollee," 
(TRUE) 


49 


71 


25 


56 


• 

3i 


60' 


50 





'pep Patier>t Care Perwnnri RN. LPN, .Medi6il^ AsKiat or Aide Receptionist 
^\HP Alh^'Healtli Pf-rsonnel 
'Rounded, may udd to 99^; nr 101'^» 

**'Afler Traminf^** denotes P(*l' personnel who attended Ann Arbor Training Session. 

**.N'ot At TraininfJ .SeHHion'* or "Witiiout Trainini^'* denoteH PCU pernonnel who did NOT attend Ann Arbor Session but attended August 6th Ses- 
sion . V ^ 



ERIC 
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Table 20 (Continued) 





After Training Session* 


Not At Training Session** 


Responses 


Total 
(N=55) 
Percent^ 


M.D.8 
(N=7) ' 
Percent^ 


PCP' 
(N^l$) 
Percent^ 


Other 
AHP2 
(N=32) 
Percent^ 


Total 
(N = 16) 
Percent^ 


M.D.s 
(N=5) 
Percent^ 


PCP' 
(N=4) 
Percent^ 


Other 
AHP* 
(N-7) ' 
Percent^ ' 


C. Don't KoQw 


• 20 


14 


25 


19 


31 ^ 


■ 20 


50 


29 , 


No Answer 


9 




12 


9 


12 






29 


total 


100 


99 


99 


100 


99 


100 


100 


101 



'PCF Fatirnt Care PrrKonnrI - RN, LPN, Medical Asaist or Aide, Recebtionists. 

^AHF Allied Health PerKonnei * 
'Hounded, may add to 99^^ or \0V/(. 

**' After Training" d'enoted PCU periionnel who attended Ann Arbor Training Session. 

'"*"Not At Training S«8Hion'* or "Without Training" denoteti K^U Personnel who did NOT attend Ann Arbor SeoBion but attended August 6th 
Session ' 
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> Table 21 

RESPONSES TO ATTIjUDINAL QUESTIONS, BY PCU PERSONNEL 
"AFTER TRAINING^*^ AND ^'WITHOUT TRAINING/'** 

Q. Ill: "By placing the Emergency Care "HOTLINE" in MHMOFs Central Office, the Central Office 
is: (CHECK ONE OF THE FOLLOWING 3 STATEMENTS)^"'** 



Response 



After Training Session* 



Total 
(N = 55) 
Percent^ 



M.D.s 
(N = 7) 
Perce r^t^ 



PCF 
(N-16) 
Percent^ 



Other 
AHK^ 
(N = 32) 
Percent^ 



Not At Training Session*"^ 



Total 
(N=16) 
Percent^ 



M.D.s 

(N=5) 

Percent^ [Perce 



PCPi 
(N=4) 
nt3 



Other 
AHP2 
(N = 7) 
Percent^ 



A "Performing 
a reasonable 
necessary 
part of patient 
care efficiently." 

B. "Is mtruding in 

" patient care under 
the guise of pro- 
viding an efficent 
service." 

C. No Opinion 
No Answer 



76 



81 



72 



44 



80 



11 

5 



TotaNv . * 



97^ 



12 



16 
9 



12 
37 
6 



20 



86'« 



99 



100 



99 



100 



50 



25 



25 



100 



14 



71 
14 



99 



'P('P V'jtient CiiFf Personnel RN, LPN, Medical Assist or Aide, Receptionist ' 
»AHP ' Allied Health Personnel 
, ^'Rounded, may add to &W or lOl'if 
"•One "'other answer nfit shown in table 
t 

*"After Training" d^otes PCU personnel \«ho attended Ann Arbor Training Session 

*""Not At Training .Session" or "Without Training" denotes PCU personnel who did NOT attend Ann Arbor Session but attended August 6th 
Sasaion ' 

••*See Appendix 8 for text of Q III 
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Table 21 (Continued) 



Q. IV: "Considering the paper work required of the PCU by Central Office: (CHECK OiVE OF THE 
FOLLOWING STATEMENTS)" ' ^ 























After Training Session* 


Not At Train 

/ 


ing Session^' ^ 


ReHpt\:^ns^^ 


T^tal 
(N = 55) 
Percent*^ 


M.D.s 
(N=7) 
Percent^ 


PCP> 
(N=16) 
Percent*^ 


Other 
AHF^ 

(N = 32) 
Percent'* 


l^otal 
(N = 16) 
Percent^ 


M.D.s 
(N = 5) 
Percent^ 


PCP^ 
(N = 4) 
Percent-* 


Other 
AHP2 
(N=7) 
Percent^ 


A "All of it seems 
reasonable and 
there seems to be 
justification for 
all of it!" 


29 


14 ' 




31 


6 






14 


B "Some of it seems 
reasonable and is 
justified but some 
, is not." 


60 


86 


56 


56 


75 


100 


1 

. 100 


43 


. V . "Very little seems 
reasonable and 
very little seems 
justified." 


2 




6 




12 






29 


No Answer 


9 




6 


12 


6 


/ 




14 


Total 


100 


100 


99 


99 


99 


100 


100 


100 



'p/'F* F^atipnt Care Personnel RN, I,PN. .Medical AsHiHt or Aide, Heceptioni.st 
' WW Allied He^ilth Personnel 
'Rounded, may add U) 99^^ or 101'^ 

" A her Train I nK* denotes P(U' personnel who attended Artn Arbor Training SeHwion. 

"* Vol At Training SesHion** or "Without Training** denotes PCU personnel who did Nfl)T attend Ann Arbor SesHion but atter^ded August 6th 
Session 




/ 



E. -The "After" Asisessmenit of MHMOP Central Office Staff 

TWb staff was given one each of the two "A(ter'* questionnaires and asked to estimafes the 
distribution of responses for physicians and separately for AHP. The instructions did not ask them to 
take into account the training impact on PCU personnel, but avoided the notion of training and 
impact completely. The purpose of the before and after comparison here is to explore if their image of 
PCU personnel has changed, and if so, in what^irection. 

Table 22 -shows the Central OflTice stafTs projections for physicians' knowledge about HMO 
features i Question iA-E, Physician Questionnaire.). There appears to have been change in perception: 
In some areas of ^^owledge the perceived image of PCU physicians has improved: Capitation showed 
a dichotomy before training, i.e., half saw all physicians knowledgeable, half saw them quite, if not 
totally, ignorant, "After" perception is much less dichotomus, and- only a quarter perceive these 
physicians as extremely ignorant. The perception about correct Benefit Package information which 
PCU physicians have also changed, with about 70 percent reporting that all (lOOT ) of the PCU 
physicians have correct mlbrmation. The previous perception had 17 percent holding that all PCU 
physicians had correct information. The remaining items do not app^er .to show any significant 
changes in an| direction. The spread for the "after^dataJs probably due to the increase in number of 
Central OfficeS^tpiP^^o ret^ponded. 

The questionnaire for AHP does not contain this set of questions and therefore no "after" data is 
available for analysis of change. ^ ' <^ ' 

The projection of degree of knowledge about provision of services cannot be analyzed in terms of 
impact because no data exists from the "before" questionnaire. Instead, Table 23 was constructed 
simply to report Central Office staff perceptions in this area: Question lA (Question IIA). The two 
sets of figures shqw the number of CentrX^Office stafT who believed 100 to 90 percent of PCU 
physicians and AHP would have correct infbpriation. The second column for the PCU physicians and 
AHP shows, the number of Central OfTice/staff who felt no one would have accurate information. 
Clearly, Central Office staff per^ive physicians^s better informed, for every service listed: there are 
more ('entral Office staff who believe physicians to be correctly informed than they believe of AHP. 

Question IB, II, III, and IV* (Appendix 9) which te^j^ttitude&^nd knowledge, as stated before, 
have no previously asked equivalents. Table 24 shows ^he item for each of the questions which 
received the largest response, when both "trained" and ^'not trained" groups' data were merged for 
PCU physicians and AHP. The predictions for the frequency with whyph physicians and AHP would 
select the indicated response are shown also. Most of the AHP predictions appear neither of c^xtremely 
good fit nor very far off. The one item which shows, extreme difference between actual response 
distribution and prediction is for alternative 5 in Question IB. Only three members of the Central 
Office staff apportioned any response for this one, and of.these one was for 100 percent of.jpesponses, 
one for 80 percent and the third for 10 percent. ^ 

F. Discussion „ , ' 

Before going, into any details about the findings of this impact evaluation, it must once again be 
stressed that th^/fiumbers involved are quite small and that -therefore the percentages should not be 
taken as other tha^ gross indications of distributions: a shift of a single response often would change 
percentages quite drastically. ^ - ^ , 

The knowledge t^ie PCU persorinel have about the Central Office organization (Table 1) does not 
seem extraordinary when one takes into account (1) that not all physicians working in PCUs ace in 
contractual relationships with jSjIHMOP but are employed by PCUs; and (2) that the different Allied 
Health Personnel either deal with only one or two departments and perhaps with none depending on 
their particular job. The departments which by their very nature require contact with personnel from 
PCUs, for example Medical, Records, proportionately are also better known by appropriate groups. 



— . . 

*Or, Physician Questionnaire Question IIB, III, IV and V. (Appendix 8 ) ' 
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CENTRAL OFFICE STAFF (COS) PII5DICTIONS OF PROPORTION 
OF PCU PHYSICIANS WHO KNOW TOE CORRECT ANSWERS TO 
HMO FEATURES* FOR "BEFOR^"** AND "AFTER TRAINING"*** 

COS RESP'ONSES, 



Number of (X)S Predicting fipecific Percentage to Indicate What Proportion of I^CU Piiysicians 
Know HMO Features "Before" and "After Training." 



PREDICTION 
' "BEFORE" 

, (N = 6) 



PREDICTION ' 
"AFTER TRAINING" 

(N=13) 



CAPITATION 



Actual' f who knew 



3 
1 



100' i 
25'} 
0''< 



44'i 



lOiY/, 
90''? 
8(y/f 

em 
im 




FEE-FOR-SERVICE 



1()(W 



',m 



Actual '( who knew 



64", 



RISK SHARING 



Actual '< who knew 



3 


1007. 




7 


100'/. 


1 


80'/. 


1 


2 


957. 


1 


50'-'} 




1 


80'-'? 


1 


20'/. 


^ It 


1 


70'-? 








1 


4(yi 






i 

i 


1 


33'-? 




67'7r 






79''? 



'('ombined fos^^roup A and (\ Table IH 

*S«> ApfM^ndiV H for te^t of IJA-E 

* ResponscM nwamed before Training Session 
'"^*R(»sponHc*< f)btained -after Ann Arbor Training Sessiofir 
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Table 22 (Continued) 



Number of COS Predicting Specific Percentage to indicate What Proportion 


of PCU Physicians 


Knows HMO Features 


"Before" and "After Training." 






\ 




PREDICATION 


PREDICTION 






"BEFORE" 


"AFTER TRAINING" 






(N-6) 


(N = 


13) 


t 










1 


f 












BENEFIT PACKAGE 






, 1 




9 






1 




1 


dm 




2 




. 1 






2 


2(y/r 


2 


NA2 


Actual who knew 




44^; 




''.50'/. ' 


■ 




HPECIALIST REFERRALS 




1 
1 




4 


100'/. 




2 




1 


80'/r 




1 




2 


50^;^ 




1 


2(K/ 


1 


.SO'/. 




1 




1 ■ 


.25'/. ^ 








2 








/ . 


1 




Actual who knew 








64'/. ' 



'(Vfmbinfd for (J roup A arvd ('. Table IM 
'Not '\nMW«*ri*d 
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Table 23 



CENTRAL OFFICfr^STAFF (COS) PREDICTIONS, AFTER TRAINING 
SESSION * OF PROPORTION OF PCU PERSONNEL ANSWERING 
CORRECTLY ABOUT THE AVAILABILITY OF SERVICES. — SELECTED 
■ SERVICES SHOWN WITH FIVE MOST FAVORABLE** AND FIVE LEAST 
' FAVORABLE**' COS PREDICTIONS FOR Q. IIA**** 

i ' ^^ — - 

Number of COS Predicting Specific Percentagetp-^fi^cate What Proportion of PCU Personnel 
Knew Correct Answer. (N= 12). -^-^ " 



PREDICTIONS 
FOR M.D.s 



PREDICTION 
FOR AHP' 



11 
1 



100'/. 



5. EKG and EEG 

7 
2 



lOO'/r 
9(W 





1 


80Vr i^V^ 


50'} 










1 


40'/J 






Actual who gave correct answer: 






85'/r 










1. PRENATAL CARE 






• 




10 


lOOV, 5 


ioo';f 








2 


90V, 1 


90'/; 








1 


liY/f 2 












1 


em 










r\ 


50'/; 






Actual ^( who gave correct answer: 




9V/( 












2. EYE GLASSES 










9 


1007^ 


2 








1 




1 


807. 






^ r 




■ 1 •■ 


^60^;? 






1 


307r 


3 


'50V. 






1 


09? 


2 


40V. 




*. 






1 


30^7. . 










"2 






-.1 

Actual who gave correct answer: 






\ 


49^>: 




^ T 




« 









•AHP Allied Health Personriql 

* After Trammj< Session at Ann Wbor., 

''*M(>st Favorable as shown by fr^buer^cy of predictinj^ lOiYi 

*** Least fayorable" as shown by frMu<^ncy of pre,djctjng (f^f , 

"♦♦♦See App»nd>x 8 for text of Q IVIM 



V 
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\ Table 23 (Continued) 




/ 



Nunfber of COS PredwfUng Specific Percentage to Indicate Wh^ Proportion of PCU ^Personiiel 
Knew Correct Ans>^r. (N-12), 



E^EOICTIONS 
FOR M.D.8 



"PREDICTION 
' FORAHP' 



2. INPATIENT H(|SPITyVLIZATION 




Actual who gave correct answer: 



Actual who gave correct answ 




6 




1 




I 


im ' 


1 


em 


1 


5m , 


1 


2m 


1 











22. AMBUL 



/ 



/ 



2 
1 
1 
9 



Actual % who gave correct answer; 



100'^ 



36'/f 



5(r/f 

20'/f 
2m 



23. TRANSPORTATION OTHER THAN 
AMBULANCE 



2 




1 


95'7f 


1 




1 


209f 


1 


10'7r 


8 





0> 



,1 

2 
2 

1 
1 
1 

4 



Actual who gave correct answer: 



27c/f 



lOO'/f 
50<7f 

40<7f 

20*2^ 

12'7f 



cP 



*AHP - Allied Health Personnel 



ERIC 



After TraminK Session Ann Arbor 

*M(mt Knvorable an qbown by frequency of predicting lOCr, Least Favorable an sbown by frequency^ofpredicting (K^ 

- ■ ■ 52 



Table 23 (Continued) 



.Number of COS Predicting Specific Percentage to Indicate What Proportion of PCU Personnel 
' Knew Corr^t Answer, (N-12). 

PREDICTIONS PREDICTION- 
.# FORM.D.s FORAHP' 



3. PLASTIC SURGE RY COSMETIC 




3. 

1 

1 

1 

7 



Actual ''/f who gave qorrect answer: 



100<7f 
40% 
20% f 
10% 
0% 



18% 



6 



90% 
70% 
50% 
40% 
30% 
10% 
0% 

29% 



9. CONTACT LENSES 





2 


100% 


1 . 


40% 






1 


90% 


1 


25% 






1 


45% 


1 


20% 






1 


30% 


9 


0% 






7 


0% 








Actual 9( who gave correct answer: 




27% 




34% 








11. TUBAL LIGATION 








3 


100% 


• 2 


100% 






1 


95% 


1 


80% 






1 


' 90% 


1 


60% 






2 


50% 


2 


50% 






6 


0% 


1 


40% 










2 


20% 










3 


0% 




Actual 9c who gave correct answer: 




27% 




34% 





'AHP ^Allied Health Personnel. 



*Afler Training Session at Ann Arbor. 

**Most Favorable as shown by frequency of predicting 100^ ; Least Favorable as shown by frequency of predicting Wr , 



1 



1^3 
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Table 24 . 

CENTRAL OFFICE STAFF (COS)' PREDICTIONS OF PROPORTION 
OF PCU PERSONNEL WHO SELECTED A GIVEN RESPONSE \ 
CATEGORY FOR Q. IB, II, III AND I V* 



Number of COS Predicting Specific Percentage to Indicate What Proportion of PCU Personnel 
Gave a Specific Answer. 



PREDICTIONS 
FOR M.D.s 

(N-13)2 



PREDICTION 
FORAHP» 

(N = 12)2 



Q. IB, Response: EnroHee has hot understood what Plan provides 



4 

1 

3 
2 
1 



80'/,. 

50'/, 
40'/, 
NA 



Actual who gave this response: 



IT/c 




Q. IB, Response: PCU Staff not correctly and completely informed 



Actual who gave this responsg: 



20'/, 
10'/, 
NA 



1 100';^ 



33'7, 
30% 

ffJc 

3% 



Q. IB, Response: MHMOP COS has not explained Plan to PC 



Actual ^ who gave this response: 



507r 

30^ 

10% 
NA 

m 



40% 
30% 
20% 
10% 



2% 



lAHP - Allied Health Personnel. 

^Number of Central Office Staff Responding on Physician Questionnaire il3} and Allied Health Personnel Questionnaire \ 



*See Appendix 9 for text of Q. FB, IJ, HI and IV. 
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Table 24 (Continued) 



n 



Number of COS Predicting Specific Percentage to Indicate What Proportion of PCU Personnel 
Gave a Specific Answer. 



PREDICTIONS 
FOR M.D.S 
(N=13)2 



PREDICTION 
FOR AHP' 

(N^)2 



Q. IB, Response: MHMOP COS has always oversold the enroUee 



2 

2 
1 
4 



Actual ''i who gave this response: 



507( 


1 




3m ■ 


1 


im 


207c 


1 


zm 




2 


25% 




1 






1 


\m 






m 



Q. IB, Response: Some instances of each of above, none in particular 



Actual who gave this response: 



1007r 



617c 



1 
2 
2 
1 



337c 
307c 
207( 
107c 

207c 



'AHP Allied Health Personnel . ' 

^Number of Central Office Staff Responding on PhyHician Questionnaire ( 13) and Allied Health "Personnel Questionnaire il2). 



\ 
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Table 24 (Continued) 



Number of COS Predicting Specific Percentage to Indicate What Proportion of FCU Personnel 


(iave a Specific Answer. 






PREDICTIONS PREDICTION 




FOR M.D.s FOR AHP^ * 




'(N=13)2 (N= 


12)2 


Q. II, Response; Primary relationship is between PCU and enrollee 


1 


1007c 1 




1 


S07( 1 


S07c 


2 


eo7c . - 1 


607c 


1 


507c ^ 2 


507c 


2 


207c 1 


407c 


2 


I07c 1 


357c 




1 


207c 




1 


107c 


Actual '■'( who gave this r,esponse> 


I17c 


247c 


Q, II, Response: Primary Relationship is between MHMOP and enrollee 


3 


1007c 


1 9(Ff 


2 


907c 


1 809'f 


2 


S07c 


i 157c 


1 


507c 


1 507c 




407c 


3 407c . 


I 


207c 


1 357c 


2 


I07c ^ 


1 307f 






1 2m 




/ 


1 107c 


Actual % who gave this response: 


ei7c 


417c 


Q. II, Response: Don't Know 




1 


S07c ' 1 


lOWc 


1 


207c • 1 


6(M 


2 


107c 1 


30% 




' 3 


20% 




1 


5% 


Actual 7c who gave this response: 


177 


24% 



>AHP - Alhed Health Personnel 

^NumbfT of Ontral Office Staff Responding on Physician Questionnaire ( 13) and Allied Health Personnel Questionnaire (12). 
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Table 24 (Continuecf) 

1^ 



Number of COS Predicting Specific -Percentage to Indicate What Proportion of PCU Personnel 


Gave a Specific Answer. 






PREDICTIONS 


PREDICTION 


FORM.D.s 


FOR AHP» 


(N=13)2 


(N 


= 12)2 


Q. Ill, Response: HOTLINE in Central Office reasonable part done efficiently 


3 100% , . 


2 


100% 


1 90% 


1 


90% 


4 80% 


^ 1 


80% 


' ■ . • — 2 70% 


^ 1 


70% 


.1 50% 


2 


60% 


■^"T 33% 


" 3 


50% 


1 25% 


1 


20% 




1 


10% 


Actual % who gave this response: • 83% 




66% 


Q. Ill, Response: HOTLINE in Central Office intrudes in patient care 


1 75% 


1 


60% 


1 50% 


3 


. 50% 


1 33% ' 


1 


40% 


2 30% 


1 


20% 


1 10% 


1 


10% 


Actual % who gave this response; 8% 




7% 


Q. Ill, Response: No Opinion 






1 33% 


1 


90% 


.4 20% 


1 


30% 




2 


20% 




2 


10% 


Actual ^ who gave this response; / 0% 




20% 



>AHP - Allied Health Personnel. .^Y^ 
'Number of Central Office StafT Responding on PhyRician Questionnaire (13) and Allied Health Personnel Questionnaire 1(12). 

i 
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Table 24 (Continued) 



Nurrvber of COS Predicting Specific Percentage to Indicate What Proportion 


ofPCU Personnel 


(lave a, Specific Answer. 
* 












PREDICTIONS 


PREDICTION 






"FOR M.D.s 


FORAHP' . 






(N=13)=' 


(N = 12)2 . 




required all seems 


reasonable and justifled 




2 


lOCT/f _ 


' 2 


50% 




1 




1 


40% 




2"- 




2 


30% 






mi 


1 


20% 




1 


15')f 


2 


10% 




2 








Actual who gave this response: . 




m 




27% 


Q. IV, Response: Some of paperwork steems reasonable and justified, some is not 




1 


W09c 


3 


100% 




2 


.im 


4 


70% 




1 


60'7f 


4 


50% 




3 


5(W 


1 


20% 




1 


4(F/f 








1 


25'7f 








2 


20*7^ 






Actual '/( who gave this response: 




92<7< 


/ 


58% 


Q. IV, Response: Very little o 


f paperwork seemsTeasonable and justified 












1 




1 


80% 




1 


659c 


1 


30% 




1 


5(n 


2 


20% 




2 


20% 


i 


10% 




1 


15% 


■\ 






2 


10% ' 
















Actual who gave this response: 




0% 


J. 


10% 



'AHP - Allied Health Personnel 

^Number of Ontral OfTice Staff Responding on Physician Questionnaire 1 13* and Allied Health Personnel Questionnaire (12). 
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The Central Office staffs perception of the PCU ifiereonnel tends to overrate physician knowledge 
on the ivhole and seems to contain some extreme images, as shov/n by responses of 100% or 0% which 
occur fairly regularly. Not evident from the data presented in th\ tables (Tables 9-13 and 21-23) is 
the fact that these «Ktremes were not held't)y particuljar individuala for each question but by different 
persons for different items. > ^' 

The lack of understanding of HMO features (Table 2) is substantiation of MHMOFs feeling that 
basic concepts need to be called to PCU physicians' attention, even if Allied Health Personnel (AHP) 
perhaps do not need to be familiar with all these conc^epts. Certainly some of the Central Office staff, 
despite their awareness of the need for training, jstill perceived the PCU physicians as better 
informed than they indeed proved to be (Table lOl). Interestingly enough, office personnel were 
perceived as well informed by half the Central Office | staff though in fact they differed but little from 
their allied health colleagues. The feeling expressed ^n comments on questionnaires that AHP do not 
need to know operating, and particularly financial ajspects of HMOs, raises an interesting question. 
Namely, would the PCUs function more efficiently if 'all personnel understood the hazards of prepaid 
group practices? 

This consideration particularly comes to mind when information about specific services and their 
availability to patients is considered. Essentially, j^s long as PCU personnel do not know what 
services are add are not available under what conditibns, it might be expected that ongoing confusion 
results in continuous tense interaction between Cenjtral Office staff and the PCUs as referrals are 
either challenged, billed, or refused, to the consteiination of the PCU. That the confusion is not 
occasional but relatively deepseated, may perhaps be | substantiated by the findings shown in Table 6. 
PCU physicians, more than half; feel that Central Office decisions about service requests are 
sometimes reasonable and sometimes not. This wopld argue either ignorance about the rules by 
which request are handled or perhaps a feeling that there are no rules, requiring frequent reliance on 
negotiation and arbitration. This interpretation is somewhat reinforced by data from Table 7, where, 
again, more than half the physicians are expressiijig the feeling that the Central Office handles 
patient complaints not by rules but by other mechajnisms. Interestingly enough, the AHP reported 
greater confidence in the way in which Central Office staff go about requests for services and 
complaints. It would be interesting to explore the reasons for these different attitudes. Unfortunately, 
the data available do not cover this area. : 

A further area of misperception exists between Central Office staff and PCU staffs, namely the 
utilization of written materials when handling rejquests for services (Table 5). At the training 
sessions, the participants expressed their conviction that either no written materials exist, or that 
they are inadequate. At this juncture it seems relevant to mention that very simple instructions in 
the various questionnaires used in this evaluation were very badly handled by a large number of 
individuals. The unusual number of "No Answers" wiere not produced by several individuals but by a 
large number. It seems to call for an assessment of two things: the level at which personnel caft' 
handle written materials and also the materials themselves. 

The true '*bone of contention" which emerged at the training session was the question of enrollee 
expectatmns and why they were unrealistically too high. Table 8, which presents data about this area 
underslafes the attitudes as expressed at the training sessions. Perhaps a more valid picture would 
have hein obtained if the individuals who refused to fill out the questionnaire because they were sure 
it was 'window dressing" and so on, had stated their opinions. 

The participants' evaluation of the Training Session w^s favorable as seen by Tables l^*,aildl5. 
The rankings are difficult to interpret without further information as to the reasons for the choiceS: 
was it the subject matter, the quality of the presentation, the time at which it was presented — all 
these questions must go unanswered. 

The impact of the training session appears to have been in the desired direction. Evidence may 
be derived from data in several tables. Table 17 shows an increase of correct information about HMO 
features for physicians. This finding is based on small numbers and is not as ''hard" as could be 
wished for, but each item shows improvement. Table 18 shows, again on an inadequate basis, that 
AHP profited from the training. The proportion of those trained who had a score of less than 0 is 
21'7r; for those not attending the session it is over half. Physicians seem to h^ve remained stationary 
in this respect: there is no discernable difference between those attending and not attending the 
training. Interestingly enough, both physicians and AHP rated the relevant session ('*d" in Table 
16 A) very similarly — it was not a favorite nor disliked vehemently except perhaps by the AHP who 
have no direct patient care responsibility. Still, some of thepi absprbed some of the information. 

Table 19 speaks, once again, to the problem of lack of information and to the ipfiore serious issue 
of not realizing one's lack. The scores (Table 18) show only 16% with 12 or over for the attenders, 
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while about the^^affie proportion (18%) reached such ^cores among those not attending, and 
physicians acc^iit for most of these higher scores. Yet there is nothing^'in Table 19 to indicate that 
PCU st^ifi^are aware of any need for more information, The Vatio of wrong to ''don't know" answers is 
revi^Iing (Tables 4 and 22). \ 

The Training Session seems to have brought about favorable attitudes towards the Hot Line if 
there was indeed a shift from ''No Opinion" to thinking of it ks a reaeonable and efficient method of 
patient care. Equally, headway seems to have been made in gaining better acceptance of paperwork 
required by the Central Office. \ 

A most interesting change seems to have occurred in the (Jentral Office staff. Examining Tables 
21-23 will shoyv that there is very little evidence of ''paranoia,'\ even when the opportunity presents 
itself. See for example response 3 for Question IB" response 2 for Question III and finally response 3 
for Question IV (all in Table 23). \ 

It would seem that some learning has indeed taken place; b^t it is, of course, impossible to say 
how much there should have been. And it seems also evident tha^ stereotypes were weakened when 
its bearers came in contact vt?ith each other and met persons who had problems and were willing to 
learn to solve them. \ 

,,,^^^,Jn short, the net impact of training has been to open channels of communciation where none 
previously existed and to point, in a very limited way, towards the closing of critical information gaps 
among members of the MHMOP'team. 4 
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PART 3: CONCLUSIONS AND RECOMMENDATIONS 



ERiC 



V-II. CONCLUSIONS 

A. Regarding the DTP Proces© 

1. Proposal Writing, Submittal, and Acceptance 

a. The original program solicitation requested "^proposala^ that would demonstrate 
methods, techniques, etc. for improving healtg^anpo^er in HMO settings. The DTP 
has successfully a^omplished this objective. ] 

b. The DTP had to balance the federal requirement for generalizability of experiences 
against the local (MHMOP) desire to undertake activities of an immediately useful 
and localized nature. The DTP project staff was, for the most part, sympathetic to 
local concerns and willingly modified its broader objectives to accommodate local 
perspectives. 

c. The original proposal was modified and-simplified during the planning phase of the 
DTP. In hindsight, it should have been less complex to begin with. A simple 
-''before-after" design without regard to control groups, appears more practical and 
appropriate to the capacities of developing HMOs. 

2. Staff Recruitment 

DMF expei^ienced recurrent staffing problems throughout the first phases of the DTP. 
This problem should have been anticipated and compensated for by building staff 
recruitment, orientation, and training into the original proposal. 

3. Planning 

Theyjjfanning phase successfully operationalized the original proposal, but took too long 
ov/mg to the staffing problems alluded to above. 

4. Componepts Development . ' , 

a. The needs assessment was not as useful as it should have been due to various 
pr6blems relating to scheduling and administration. The needs ' assessment did 
contribute to the curriculum development. However, it was not well integrated into the 
evaluation design. 

b. The MHMOP MIS baseline and follow-up "knowledge level" surveys served DMF 
needs n>^sonably well. However, adequate pre-testing by MHMOP could have better 
served DMF training needs by allowing for modifications in thd^ instruments prior to 
training. 

c. Training program logistics ^ere, on the whole, well co-ordmated. A notable exception 
was the use of audiovisual materials which for the most part was not well integrated 
in the structure of the conference formats. 

d. MHMOP staff were, on the whole, responsive to DTP guidance regarding the* structure 
and content of training lectures and discu^^ons. Howej/er, insufficient time was made 
available by MH^OP staff to the preparation and formatting of their presentations. 

5. Training Conferences 

a. The conferences were well received by the PCUs. 

b. The informational content of .the lectures and discussions covered topics of concern to 
PCU staff. ^ 

^1 c. The tone and content of PCU staff comments strongly indicated a feeling of isolation 

and ignorance about the MllffOP system and the HMO process. * 

d. Coupled with PCU staffs' lack of information was the clear indication of little 
communication, outside routine encounters, between MHMOP and PCU staffs. 

e. From a purely process point of view, the main success of the DTP conferences, was to 
provide an initial framework for discussion and dialogue between MHMOP and the 
PCUs and among the PCU staffs. / 
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Regarding the DTP Impact 

1. The State of Kr\,owledge and Perceptions Prior to the Training Conferences: / 

a. PCU physicians ^nd AHP did not demonstrate extensive knowledge about the 
MHMOP system. , ^ , ^ ' V 

* b. MHMOP Central Office staff tended to somewl^ajyoverrate physiciin,^1^4^'^^'®^8® 
about the Plan, wh4;ie somewhat underrating AHP knowledge. ' 

c. ^ A significant number of PCU personnel ^(both pHysicians and AHP) refuse3\to 

participate in th^ MHMOP. baselinp MIS survey indicating, suspicion of MHMUl 
Central Office motives. jj , ^ 

2. The State of Knowledge and Perceptions lAfter /Training: 

a. ,The general direction of the training jprogram^s impact was positive. ^ 

b. Physicians and AHP information le^ls somewhat increased. 

^ c. Levels of frustration and suspicion of MHMOFs motives* appear to have been 
significantly reduced. • 

d. MHMOP staff tended to display greater sophistication in their views of PCU levels of 
knowledge and capacities. In particular, there was less of a tendency to rely on 
stereotypes of "physicians," "nurses," etc., but to perceive the PCUs more accurately. 
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VIII. RECOMMENDATION$ 

/ 

A. To the Bureau of Health Manpower 

1. The DTP accomplished its basic objectives and therefore warrants continued interest by 
DMF, MHMOP, and the Bureau of Health Manpower. 

2. TARP is particularly concerned that the progress in communications and knowledge 
developrpent clearly indicated during the DTP contract period, not be lost because of lack 
of support from the Bureau of Health Manpower. We therefore urge the Bureau to 
consider ways to continue the DTP and to expand and modify it based on the just 
concluded experience. Much v^as learned. Useful products were produced. MHMOP must 
continue to pay attention to staff development reqilirements. Otherwise the limited gains 
of the DTP will be ^^uickly lost. 

B. To the Detroit Medical Foundation and MHMOP 

1. DMF and MHMOP should recognize the importance of staff development activities such as 
the DTP. MKM*©?, in particular, should place the DTP high on its agenda of activities in 
need of on'-going consideration. 

2. Future DTP efforts should concentrate on permanent training staff development, and 
ways to ultimately subsidize such efforts through MHMOP income, rather than through 
continuous reliance on outside support. In the short run, however, the Bureau of Health 
Manpower should recognize the need for additional federal support. 
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PART IV 
APPENDICES 




michigan hmo plans, Inc. 

a non profit cof pof ottcn 

APPENDIX 1 — "Special Needs Assessment Form'* 



PLEASE USE BRIEF ACTION STATEMENTS 

What would you like to have included in a training activity that "would be beneficial to you in 
working in this center? 



What would you like to have included in- a training activity that would be beneficial to you in 
working with HMO Central? ^ 

6 



\ 



What kinds of, changes would you like^o see hat)pen as a result of training? 




\ 




mlchigan hmp plans, Inc. 

0 non-profit corporation 



n. FoUqw ai*e some terms and for each th^e are several^ deHnitions. Place a check in the box next to 
the onfes3(ou think is most nearly correct when used in relation tollMOs. 

A. Capitation (for HMOs) can be defmed as: - « 

□ 1. An insurance preibaiu|:ii, of which the amount depends on who the enrolled person is. 

*. * 

□ 2. Some fixed amount paid per enrolled person. 

□ 3. Some fixed amount paid per enrolled person for a fixed set (package) of services. 

B. Fee-for-Service Feature of HMOs is: 

□ 1. A portion of the funds, which pays .the higher compensation rates of members 

(doctors) who are classified as consultants or "Specialists. 

□ 2. A portion of the funds which pays medical* services not provided by MHMOP but 

covered by the serviw^package for the enrollees. , . 

□ 3. A portion of the funds which pays for physician services rendered to the patient 

while in hospital. ^ 

C. Risk Sharing in HMOs* , 

□ 1. Is a form oT malpractice insurance. 

□ 2. Means that any deficit incurred by your health center will be directly paid by your 

g?^Jup and your group aloneP 

□ 3. Is a portion of the total capitation set aside into a reserve fund to protect the 

financial interests of all health centers. , > 



— Continued 




michigan hmo plans, inc. 

0 non profit corporation 



Cont'd. A 

D. Beneflt Package in HMOs: 1» V ' 

O 1. An identical range of health services which are guaranteed by MHMOP, regardless 
of the medical ^oup in which the individual ia enrolled for care. \ 

□ ^ 2. The range of health servic&s to which an enrollee is entitled and which is defined by 

the individual medical group contract. ^ 

^ ' . ' ■■ . 

□ 3, Those health services deemed necessary by the patient's physician^ 

E. Referrals to Specialists who are not under a capitation contract with MHMOP are 
paid for by: j 



►ut ot capitation with prior approval of the MHMOF. y ^ 

ut of the risk sharing fund with prior approval of the MHMOP' 
»ut of the fee-for-service fund with prior approval of the mediicaj group. 
□ 5. None of these. (Please describe your understanding of this pa3anent arrangement.) 



□ 


1. 


□ 


2. 


□ 


3. 


□ 


4. 


□ 


5. 




f 
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michlgan hmo plans, Inc. 

Q non-profit corporotion 



III. Below ia a list of services which enroUees may either need or request from your group. For 
EACH check ONE box. 



Health Service 


Provided by 


Not 

nrovidpd 

at all 


Don^t 
FCnow 

il^tlV/ vv 


Your 
group 


Referral 
from you 


Referred 
from MHMOP 
Center 


1. Prenatal Care 












2. Eye Glasses 












3. Rhino-plasts 
icosiiieticj 












4. Outpatient 
X-Ray 
Studies 












5. EKG & EEC 












6. Abortions 












7. Dental Care' 












8. Psychiactric 
outpatient 












9. Contact Lenses 












10. Emergency 
Room 
Services 












11. Tubal 
Ligation 












12. Vasectomy- 












13. Inpatient 
Hospital- 
ization 






V ^ 
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michlgan hmo plans, inc. 

0 non profit corporation 



(Cont'd) 





Provided by 


Not 
provided 
at all 


Don^t 
Know 


riealtn oervice 


Your 
group 


Referral 
from you 


Referred 
from MHMOP 
Center 


14. Dermatologists 












15. Allergists 












16. ^j^odi^rfnSt 












17. Nutrition 
Counseling 






> 






18. Health 
Care 

(domestic) 








Y 




19. VNA 












20. Psychiatric 
Inpatient 






r 






21. General Surgery 












2± Family 
Planning 












23. Health 

Education 


1 




> 






24. Prescriptions 












25. Ambulance 












^26. Transportation 
(other than 
ambulance) 
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mlchigail hmo plans, Inc. 

0 noh profit corpormion 



III. (Cont'd) 

When you talk to an enrollee about a request for a specific service, do you: 

□ 1. Refer to a written guide, list or get of instructioiis to help you. 

□ 2. Consult with someone in your office. 

G 3. Call up the MHMOP Central Office. ' ' . 

□ 4. Already know the apswers because you have been doing this for so long. 

IV. Which of the following statements best reflects your experience with MHMOFs Central Office: 

A.^ In regard to enroUees' service requests: (CHECK ONE) 

□ 1. People at the MHMOP Central Office are unreasonable and demand special deals 

whenever a patient calls them up and makes waves. 

□ 2. When the MHMOP Center people call up about a service request, it's usually a 

situation where they are justified in intervening. 



□ 

B. 

□ 



3. It's hard to say; sometimes the MHMOP Center people are reasonable and other 
times they are not. 



V 



In regard to complaints by patients: (CHECK ONE) 



1. The MHMOP Central Office always takes the pdtient's side and dpesn't listen to 
reason. j 

The MHMOP Central Office seems to make reasonable evaluationi^ of complaints and 



The MI 
^""eails to 



our attention usually on those where a problem does exist. 



□ 3. It is hard to say; sometimes the MHMOP Central Office seems to take sides, other 
times it seems to be reasonable. 




(HI 
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michigan hmo plans, inc. 

0 hon profit corporation 



V. Now a final question. Please check the one statement that most closely reflects your experience in 
regard to Enrollment: ' ^ 

□ 1. The people at the^'lSHlMOP CentWd Office who enroll new members either don*t 

know about-'the services that are cw^red or else they deliberately exaggerate just to 
"make a sale", because most ni§;ftt^nrollees demand much more than they are 
entitled to. 

□ 2. Some^ew enrollees don't seem to know what joining MHMOP means and what they 

are entitled to, but some new enrollee^do know fairly accurately. ^ '"^^ 

□ 3. Most of the time, new enrollees know what they are entitled to and what enrolling' 

means. 



Please indicate your function in youi; health center by checking the appropriate box: 

□ Patient Care: Physician 

□ Patient Care: RN, LPN, Medical Assistant or Aide, Receptionist 

□ Office: Administrator or Administrative Assistant, Manager, Typist, Clerk, Secretary, 

Billing, Accounting, Bookkeeping 

□ Other: Medical Records, Laboratory or X-ray Technician, etc. 



THANK YOU! 
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APPENDIX 3 — "State-of-Art Review^' 



A STATE OF THE ART REVIEW OF 
THE LITERATURE ON TRAINING PROGRAMS 
yVlTH RELEVANCE TO 
HEALTH MAINTENANCE ORGANIZATIONS 



June, 1975. 



Submitted to the Detroit Medical Foundation 
in ^rformance of Sub-Contract Obligations 
und^ US DHEW Contract No. 1.MB.44196, 
'Demonstration Training Program," 



r 



TARP, Inc. 
705 G Street, SE 
Washington, DC 20Q03' 
(202) 544-6312 
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STATE-OF-THErART . 

1. OVERVIEW ^ " 

The following "StateTof-the-Art" review was undertaken for the Detroit Medical Foundation*© 
Demonstration Training Program. The purpose of this program is to improve the capacity of primary 
care unit staffs to function witfeln the Health Maintenance Organization setting. The objectives of the 
training program are to: ^ " 

• Design aa appropriate curriculum for staff of primary care units to gain important 
^owledge and information about the operational components of their HMO plan, 

• DeveUip training methodology appropriate to the implemenUtion of the curriculum. 

• Ev^iluate all aspects of the training demonstration.' 

• Produce a model training manual outlining the training procedure th&t should be 
followed by other HMO's. 

The specfific task of this review, based on the preceding objedtives, is to review th^ literature, 
government reports,, and all training manuals which are presently availably Thej^ose of the 
revievy is to provide useful material for various aspects of the developing cHTriculoiH: The review is 
specifically focused on the nature of the group to be trained. 

The format for the "State-of-the-Art" paper is as follows: 

• A presentation and discussion of the data review methodology. 

• IPresentation of the State-of-the-Art. , 

• The significance of the review and its implications fopHhe training program. 

\r » 
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2. METHODOLOGY 

An eiitensive reviev/ of the literature'^tes- been undertaken, beginning with the exploration of 
citations m the follov/i,ng bibliographies: 

(1) Comprehensive Bibliography on Health Maintenance Organizations: 1970-1973, 
compiled by Patricia N. Pifiel, Dirgctor, Library Reference Service, Medical Groiip 
Management Association. ' " ' 

(2) Selected Annotated Bibliography on "Health Maintenance Organizations and 
Organized Health Care Syst^s" compiled by Alan Bloom and Paul Kosko, He^alth 
Maintenance Organization Program Office, U.S. Public Health Service, August 1973 
and Special Supplement to HMO Bibliography, April 1974. 

(3) Planning, Organizing and Evaluating Training Programs, Personnel. Bibliography 
Series No. 41, U.S. Civil Service Commission Library, Washington, D.C., J97l. 

Next, a list of technical assistance projects and reports was obtained from the Federal Health 
Maintenance Organization Program Office. Contact and r^p^ated follow-up was made ^ith those 
projects having reports which were considered relev^t to 'thfe review. This determination was based 
upon the brief description on the list. The poor'"* Response for the various pr^fts^ precludes this 
source's inclusion in the review^ f 

Contact was also made with the National Medical Libraries Audio-Visuat^Ccfnter. The center is 
currently compiling a national survey of instructional materials related to the^health field. Their 
product will be a data base which included, type of health training materials; m assessment of 
its instructional valufe; evaluation of the training materials and classification by audfence type. This 
resource will be available by mid-summer, 1975. A site visit would 'provide sources for the 
development of specific training materials, methodologies and evalnaftion designs for the DMF 
project.* , 

In addition to these specific source catalogues, indexes and abstracts tvere searched at Countway 
Medical Library in Boston, Massachusetts, and the School of Public Health, University bf Michigan to 
identify publicati6ns not cited in the compilations previously mentioned" The headings used tp search 
the various catalogues, indices and abstracts were: 

Public Health 
Prepaid group practices 
Group practices 
Neighborhood health centers 
Health maintenance organizations 
Team training 

Health team training ^ 
Health manpower training , ^ . 

Health training 

Health education p ' I 

Education ^ ^ . 

Health organizations training 

Training methodologies experiences and-or evaluation 
Of the headings researched, the following Have no pertinent information: prepaid group practices; 
neighborhood health centers; public health; and health team training. 

The following list identifies the most useful of the indexes and journal abstracts examined: , 
Index Medicuis 

American Journal of Public Health ts* . 

Medical Care 

Medical Care Review 

Health Service Reports 

Hospitals 

Training & Development Journal (and other \ 
American Society of Training and ' 
Development Officials materials) 



*Froin a discuooion with the asaiBtant Director for Audio-visual Education deveiopment, it was concluded that such a visit would be most 
useful in developing gpscific i'natructiona) media Therefore, the training program coordinator should visit the center to discuss and develop the 
gpe^ific audio- vioual components of the cumculum { . ' 
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J Milbank Mcfmorial Fund Quarterly ^ 

f Journal of the American Medical Association 

j World Health Organization Technical Reports 

Journal of Medical Education 

Education Index . 

At this stage, articles were excludfed from the review based on length (i.e., one page or less). 
Those editorials whicli did not indicate sufficient information were also excluded. 

The literature was classified into the following areas prior to the r^ew of materials. The 
classification processes consisted of: ■ \ - 

(1) Grouping by training studies and non-studies. Training studies were examined to 
identify the type ofaudience methodology and evaluation designs. Non-studies are included based on 
relevancy of experience to team training in health settings. Both studies fpd non-studies were 
considered based oji^^Heir potential usefulness to the prospective training prograif^ 

(2) Grouping byHOTO content areas. The areas of concern delineated we^e: ^HMO philosophy 
and concepts; provider orientation apd concern^; quality of care in prepaid groups; HMO health 
delivery systerns;»HMO marketing, HMO information systems; and HMO financing. 

The plan of analysis entailed cataloguing data according to the preceding classification scheme. 
To further meet the review objectives, the data was then applied to the various components of HMO 
operations with implication for team development; and to training methodologies and evaluation 
which are hot substantively delated to HMOs but which might have implications for team building in 
innovative''8etting8. The underlying criteria of inclusion for each publication and training instrument 
is its contribution to the successful dissemination of information and its potential in adding to the 
.knowledge of trainees regarding increasing team efficiency and plan management. 




3. STATE-OF-THE-ART LITERATURE REVIEW 



3.1 Training Studies and Non-Studies ' 

3.1.1 Criteria for Review 

Criteria for inclusion of articles in the training section of the state-of-the-art review are the 
following: , 

1. Is the described training inter-disciplinary in nature? 

2. Dees the literature discuss training for those v/ho have limited exposure to team training? 

3. Is th6 training example focused on changing attitudes, knowledge and behavior? 

4. Does the literature describe a training methodology in detail? 

5. Does the literature diacuss and-or provide model evaluation instrumentsTor training? 

6. Articles less than four pages and purely descriptive were usually excluded. An article, boolc or 
study was included if its analysis resulted in a positive response to any one of the preceding 
five questions. * . ' 

3.1.2 Review - ^ 

1. y.S. Civij Service Commission Bureau of Training, Visual Materials: Guidelines for Selection 
and Use in Training Situations, Training Systems and Technobgy Series, No. VI, U.S. Civil 
Service Commission Office of Training Assistance, December 1971. 

The paper discusses the characteristics, advantages, limitations and uses 'of the most 
commojily encountered instructional media. In addition, it offers guidelines that a training 
specialist can use when selecting visual materials for group instructions. Indicators ofjieed 
for visual training materials are identified. The design characteristics of visual use are 
explained. Techniques and functions are described as well as the various types of soft and 
hardware use^ in visual presentations. A follow-up evaluation is .also presented. Th§ 
evaluation form for instructional materials indudes a rating of the materials based on 
clarity of ofejeeUws; clarity of organization; appropriateness for cout'se; sufficient emphasis 
on important points; ability to hold the attention of the audience; and clarity of detail. Of 
secondary importance was: treatment appropriate for subject matter; rate of introduction of 
concepts; integration of verbal and pictorial- content; and number of concepts. 

2. Baird, Leonard, "Common and* Uncommon Models for Evaluation Teaching," New Directions 
for Hijgher Education, No. 4, '1973. 

Four approaches to the evaluation of teachers ranged from: (a) the highly detailed to the 
global; (b) specific goal attainment to the environment that determine goals; (c) a 

formal model to the process of teaching; to, (d) a broad aSessment of the environmental 
field of forces on the teacher. The standard model of evaluation deals with goal 
determination. The design of relevant materials, and measurement of progress in attaining 
objectives. Consideration is given to 'the attainment of objectives and the costs ^ociated 
with differential attainment of objectives. Consideration is also given to various teaching 
approaches and roles. General theories of human cognition applicable to teaching within 
the standard, model are: (a) the anchoring of broajd philisophies of life and/or ideologies in 
the student's structure of ideas; (b) vertical transfer^f learning from one behavior or 
cognition level to a higher one; and (c) discovery of learning where students, by inductive 
reasoning, infer a concept or principle. - 

3. Carlaw, R.W. and C^teftrJL.B., "Team Training — An Experiment with Promise," Health 
Sciences Report, Vtsf. 88, No. 4, April 1973, pp. 328-336. 

The article examines team training as a concept and its importance for public health 
practitioners. The learning constructs identified were tested in a team training experiment 
among county health teams in Georgia. A training program was designed using PERT as 
the primary planning model to be undertaken by the teams. The training goal was to 
promote the widest use of skills in multidiscjpHnary approaches ^y^^^^^^ul definition, 
plai;inLng, and program implementation. A pr^-traiaing program was designed to involve 
team members in the identification of projects on which they would work. An evaluation 
and follow-up intervention strategy was also used. The methodological emphasis was on 
working in dyads and triads'on consultation for teams and individuals. Most of the training 
situations were based on real situations. Role playing was used effectively at appropriate 
times. Partici^^t responses were highly positive. The only difficulty in Reforming an 
adequate evaluation was the inability to perform objective field measurement from the 
instructor's perspective. 

^ V H8 , 

2" 1 



4. Havelock, Ronald, and Havelock, Mary C, Training fbf^ Change Agents - A Guide to the 
,Deoign of Training Programs in Education and . Otner Fields, Center for Rdeearch on 
Utilizatii^n of Scientific Kno\vledge, Institute for Soci^lyResearch, The Univerofty or Michigan, 
Ann Arbor, Michigan, 1973. ' _^ f - 

This book ia intended for uee by change agents aixti change agent trainees in all levels of 
education and in other human science areas wherer specialized, resource helpUjgjind^inking ' 
roles are being developed. Part One provides a /framework for the design of programs to 
train chapge agents in the skills of fecilitating change and of-regoufce utilization. Part One 
includes the theory, goals and structure essential to ^ogram design. The first chapter 
focuses on the major perspectives on the change proce©^ They are grouped under tlie 
following headings: change as .^ problem^eofving process; change as a research-development 
and diffusion process; changj&^ a'process.of social interaction; change as a linkage process; 
and, conflict theory ^ change. Chapter Two focuses on the- issues around goal setting. 
Chapter Thre^ identifies some principles of goal training design. These principles include: 
/ relevatice; specifity; generality; reinforcement; in-process ev^kisstion and feedback; openness 
\,and flexibility; linkage; involvetneat; cost effectiveness; redundancy; synergy; training for 
psychological wholeness of learning; training for transferability; and compatibility. Chapter 
j/ . Four focuses on framework for training designs. Eight elements are analyzed which are 
^ -primary to whole-Vole draining'. They are: 

SL^ definition and rationale for the role; ' ^ 

b. criteria for trainee selection, < 

c. * outcomes expected of trainee© (attitude and values; knowledge; skills), 

d. ways to provide training to achieve these outcomes, 

e. ways to set the role in an ir^stitutional context, ^ 

f. criteria for program success, • 

g. evaluation processes for a training program' and . |^ 

h. utilization of evaluation. . , . " r r 

Part Two considers five training program models: 1) programa ta-trarn school systems 
to develop a self-renewal capacity; 2) programs for change agent linkage of school systems 
• to resources; 3) progri^ms to effect political and structural changes in school systems; 4) 
programs to improve the effectiveness of other edi^cational agencies; and, 5) a sample model 
of a fully develope<i training design. * , ^ . 

■ ^ ,. 

5. U.S. Civil Service Commission, Bureau of Training, Training Evaluation: A Guide to Its 
Planning, Development, and Use in Agency^ Training Courses, Training Systems and 
Technology Serie^, No. IQ, U.S. Civil Service Commission, May 1971. 

This paper describes an approach which can be iised by the agency training specialist to 
assess the effectiveness of many internally developed and conducted training courses. The 
paper offers a conceptual framework for evaluation; .the essential ^teps in developing 
training objectives; an in-course trai^iing evaluation process; and, a description of the steps 
involved in developing aiid^sing data gathering instruments. The paper concludes with a 
discussion of the factors to be considered when implementing t^e • kind of evaluation 
program described in this paper. They are: 1) course content which is influential and the 
amount of measurement which can be applied^) the learning level of the coui^se (what is 
its purpose); and 3) course costs (per unit (trainehi costs and frequency of courses given). 
Overriding factors are the degree of control exercii^li by the agency over course delivery 
and the resources available to the agency. The development of direct ^measurement 
instruments entails the following steps: ' i 

a. Decisions as to what is to be measured, 

b. The development of measurement matrix, 

c. The development of the elements of the measurement instruments, 

d. Assembling the measurement instrument, 

e. Preparation of directions far administering the instrument, 

f. A pretest of the instrument, ^" ^^ _ ^ 

• g. Establishment of the critical point, ^ ^r-^--^^ 

h. Administration of the instrument, ^"^- ^^ 

i. Analysia and evaluation of results of the instrument, and ' ^ 
j. Revisions of the instrument based on the above analysis, 
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T\vo kinds x)f iadipeet measurement 1nstrumenti|;^e discussed: thdbe desi^e^ to. gather 
and those for collecUngTh^njpieimii^f qualifi classroom obsorvers. The 
same steps de3erffieff~^garH€*...^reapplied with the two^'eiri^pti^ns: there js .need t6^ 
develop a measurement matrix, anJTiir-«es4^®st^t)l'^h critical achiev©raentjgom\^ 

6. Nagi, S., "Teamwork in Health Care in the U.s!'^^^^^^^^'"^^ 

. Memorial Fund Quarterly, Winter 1975. ""^^-^ 

This paper revie^v^current studies, imporf^nt findings, ^nd points out f^Bea^ch dimensions. 
Themes promiiient in the literature rel^ to the following concepts: a), stattis^^ower, 
authority, and influence, b) roles QnJJ pr@|&saional domain's, and c) defcision-making ted 
communication. A iiumbeF^-of— impoidaht^S^ seem to Be neglected ^uch as the 

effectiveness of teams as an approach to^th^eliveiy-^^ryices, the modes of organization , 
and the dilemma of gate-keeping^^cisiona, and the relationB^^^^team approaches to 
manpower problems. In the main', the task in this paper h^s been one^^^Qnceptual 
development, ayatemization of literature, nand identification of neglected toi^ica. The wst 
majority of the literature on teamwork ia dfescri^ve and prescriptive rather than 
analytical. The follov/ing points were made: a,) a common ^characteri^ic ,ahared by heah^h 
teama is the direct face-to-face interaction aftiong 'members in^the course of performing 
servicea; b) ambiguity of roles in certain profeasions and the overlap among them^can be a 
source of difficulty in organizing teamwork; and c) the structure of decision-making delates 
i closely to the structure of roles and authority. 

I I , . •• * • 

7. Baum, Bernard R., Soren^n, Peter F., and Place, William S., "The Effect of .ManageHal 
Training on Orgamzsatton^l Controi: An EKpeVimental Stud^'\^Organizat^nal Behavior and 
Human Per for nmnce Vo\.^y 1^1 Q. j ""^""^^^ ' - 

The utilization of or^aniz'atioimheory in the^evaluation of managerial training ia explored. 
Participants in a maAagementf training program involving^the concepts and techniques of 
"power equalization" and the "interactiorUafluence" model comprised, the experimental 
group. The group /waa cohipared on a before and^ three-months-after training basis with ^ 
control group. Tannenbaum'a control q^iestionnaire was employed to determine the* effect of 
such training on the organizational control atructu^g. Change in the direction of-a more 
egalitarian control structure was founcHh the experimental group? 

8. Eliaaon, Alan, "A Study §f the Effe.ct/of Quantitative Training," Academy ^Management 
Journal, June, 1972. . 

Tvyo groupa of subject?, om witR advanced quantitative training, and the othSr wittt little 
or no quantitative trainitig, were exposed to an interactive-decision simulation gaming 
model to experimentally /teat possible effects of quantitative traihing. The findings show 
that the quantitative gr0up achieved a higher level of gamq performance, Jbut were unable 
to justify why gaming ^feciaions were necessary. Other conclusions identify ^Joaaible ^as of 
weakness in quantita^ve training methodology. ^ 

9. Fordyce, Wesley, Mmt}Lging With People, Addison- Wesley Publicalimi9,-Maple Park, Cal., 
~ 1971. " ^ , - 

A moiilel ia preseir^d which is designed to improve organizational functioning. The model 
"^"^ addresses percep^ons of work groups and staff as to their roles and re sponsibilities. These 
varied peEceptipjis provide input to determine what interventions are required. 



10, Hall, Jay, and Williams, Martha C, "Group Dynamics Training and Improved 
Deci3ion-Making", Journal of Applied Behavioral Science, Vol. 6, No. J, 1970. 

The efficacy of laboratory training in group dynamics as a 'technique for modifying group 
processes in the direction of theoretically more effective practices was explored: Thirty 
groups t^ainecPin group dynamics w^e compared with' thirty untrained group&with respect 
to their performal^ce ox\ the 12 Angry Men^ D(6cision Making Task. Several differences 
among co-varyii)g performance^ and process variables w^pe^dentified in trained versus 



untrained groups. 



11. Petty, M.M., **Relative Effectiveness of Four Combinations of Oral and Written Presentation 
dt^ob Related/ Information to Disadvantage Trainees", ,Jozirna/ of Applied Psychology. Vol. 

N(r. 1, pp. 105-6 1974. ' ' > . 

^-^Selative effectiveness of four different cq^binationS'Of.oraPand written presentations of 
information was investigated. It was hypothesized that the treatments which began with 



an oral presentation would be more effective in disseminating information than the 
treatments which began witli written presentation. The criterioil of effectiveness .was a 
multiple choice test designed to measure the subject^s knowledge of the disseminated 
information. All eight a priori comparisons made on the basis of the research hypothesis 
were in the expected direction, but only three were statisticgilly significant. V <^ 

12. World Health Organization, Technical Report . Series No. 521, "Training and Preparation of 
Teachers for Schools of Medicine and of Allied Health ScienoBs", Report of a WHO Study 
Group, Geneva, 1973, 

' This report focuses on the preparation of teachers. The process and- methods of education 
' are reviewed. It includes a description and evaluation of various^ teaching methods and 
instruments such as: the lecture, group discussion, tutorials, clinical laboratory and field 
teachings, research and proj^t teachmg, test^g, team teaching, and simulation. While the 
primary theme of the article is on developing teachers' .ability as instructors, the article is 
useful in its assessment of teaching customs. 

The following is the assessment of the teaching methods and instruments as identified: 

1. The lecture is nteither the most efficient nor the most effective method of imparting 
knowledge. It should be used sparingh/in order to maximize its effectiveness. 

2. Group discussion has been adopted as an important instructional devise in many 
^ curricula for the'^ealth professions. Effective group leadership requires that the 

leader listen^ more than talks to avoid the trap of lecturing to a small group. 

3. Tutorials are frequently used as drill or quiz sessions rather than opportunities for 
student expression, exploration of ideas, and guidance from a sensitive monitor. 

4. Clinical laboratory and field teaching should be designed to allow the^tudent to 
explore and conjplete a project. , " 

5. Research and* project teaching though costly are invaluable methods that allow 
students to gain expedience in problem identification, problems pursuit, data analysis 
and synthesis. ^ , * " ^ ' 

6. Testing can be used as an instructional device. 

.7. Team teaching has great advantages; however, it has not become of common usage. 
8. Singulation is an easily available and readily adaptable supplement. to reality. 

13. McTeenan, Edmund and Hawkins, Robert O., edp.. Educating Personnel for the Allied Health 
Professions and Services, St. Louis, MosleVy 1912. - - * ^ 

Two chapters which focus on developing the educational program would be highly useful in 
developing training and. methodology. Th6y.are: Chapter 6, Planning the Curriculum, "pp. 
57-65; and Chapter 8, Instructional Technology, pp. 85-110. Chapter 6 covers .how to 
establish educational objectives in light of student needs; the basic organization of learning 
of^ortunities; and evaluation and updating^ of learning objectives. Chapter 8 continues with 
a discussion of choosing teaching strategies and various modalities of instructional 
technology. 

14. Odiorne, George S., Training by- Objectives ^ New York, MacMillah Company, 1970. 

This book, focuses on the design of training based upon stated objectives. It reviews the 
process of identification of training needs and alerts the' trainer to problems which must be 
addressed. A point especially identified is the need to - incorporate^ the effect of messages 
being received by the trainee outside of training. \ , 4 

15. Pierleoni, Robert G., "Teaching Health Care Professm^ls*', Journal oY the Kansas Medical 
Society, March 1973, pp. 1-8, 68-71. ' 

An instructional design model is discussed. The model contains four components, each 
representing a product or series of products. They are: pre-assessment of the learner; 
instrumonal objectives; instructional procedures; and evaluation. procedures. The emphasis 
is places on teaching the learner, not on teaching the subject matter. 

The preVassessment of the learner is "a series of statements regarding the learning 
achievements. The instructional objectives should be stated, in terms of leaimer behavioral 
outcome^ and should be observable and measurable by the instructor; ahd^ minimum 
J)erforTnanc^ standards should include the design of appropriate procedures and the 
selection or preparation of measuring devices. 

They shou^ be based on the behavioral requirements of the objectives and on the abilities 
of the target learners. 
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16. Van der Embse, Thomas, "ChoosiM a,J^fSnagement Development Program: A Decision 
Model", Personnel Journal, October 1973, pp. 907-12. 

The article discusses, in depth, an experiment in team training. The goal was to train a 
multidiseiplinary group in vario^ approaches to the resolution of public health problems. 
A description of the training process ''and workshop evaluations are included. The 
methodological emphasis was on working in dyads and triads. Role playing was also used. 
The evaluation procedure, while limited to participant responses, could be useful for any 
training effort. ^ 

17. Rubin, Irvin and Beckhard, Richard, "Factors Influencing the Effectiveness of Health Teams," 
Milbank Memorial Fund Quarterly, July 1972, Part 1, Vol. 50, No. 3, pp. 317-335. 

The central focus of the paper was upon the internal dynamics involved when a collection 
of individuals attempts to function as a group. The objective was to provide a framework 
that will facilitate consideration of several important issues involved in the more effective 
utilization of groups in delivering health care. Several key variables known to b^^ of prime 
importance to any group situation are discussed in light of their relevahce to group medical 
practice. They are: goals or mission; role expectations (internal and external); 
decision-making; communication patterns; leadership and norms. 
Implications were: 

1. Some conscious program that helps team members look at preceding variables is 
essential for team effectiveness. ' jr ^ / 

2. Behavioral science knowledge and techniques developed in a variety of non-medical 
settings are relevant and appear to be transferable to organizations involved in the 

f delivery of health care. 

3. Capability for helping teams look at their own workings should be built into the 
training of team leaders. , 

4. The organization needs to develop an internal capability to help groups manage their 
own process. ' * ' <j 

5. Programs should also include a focus on the problems of helping people cope with 
cultural discrepancies. v 

6. The development ofteam leadership and membership skills should occur. % 

7. The team should be trained as a unit. 

8. Socialization of new team ixtembers should be examined. 

18. Buchanan, Paul C, "Laboratory Training and Organizational Devalopnient", Administrative 
Science Quarterly, Vol 14, No. 3, 1^169, pp. 466-480. 

The purpose of this paper was to update an earlier review of the literature on the 
effectiveness of laboratory training in industry and other organizations. The findings as to 
the value of laboratory training are: 

1. It facilitates personeil growth and development and, thus, can be of value to the 
, individual who participates. 

2. It accomplishes changes in individuals which, according to' several theories, are 
important in effecting change in organizations and in effectively managing 
organizations. 

* 3. One study, in which an instrumental l&boratory approacl^ was compared with 
sensitivity training, provides §ome indication that more organizational change 
resulted from the instrumental approach. 
4. Xhe findings from this literature search are compatible with the conclusion reached 
in a similar review madeibur ye^rs ago. ' ' 

19. Balman, Lee, "Laboratory Versus Lecture in Training Executives", Journal of Applied 
Behavioral Science, Vol. 6, No. 3, 1970, pp. 323-335. 

Four different sessions of an educational program for business executives were studied to 
compare the differential effects of laboratory human relations (T-Group) training versus a 
lecture^Hiscussion approach to interpersonal relations in organizations. Both type^& of 
programs produced equal change irt participants' stated beliefs about effective interpersonal 
behavior. Laboratory training showed greater effects on participants' perceptions of 
themselves and on their behavior as analyzed from tape recordings of case discussion 
meetings. However, there was evidence that the participants had difficulty transferring 
learning from the T-Group to other parts of the program and that there was considerably 
fade-out of the effects of training. . 

2-5 ^52 
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20. Golembiewsik, Robert T., and Carrigan, Stokes B., "Tha Persistence of Laboratory-Induced 
Changes in Organization Styles", Administrative Science Quarterly, Vol. 18, No. 3, 1970, pp. 
330-340. 

Changes in interpersonal and intergroup* styles in a small managerial population were 
observed following exposure to a. learning design based on the laboratory approach. 
o Managerial self reports on the Likert profile of organizational characteristics were used to 

gauge change. This report establishes the basic persistence of the initial changes over a 
period of some 18 months. Despite various inelegancies of the design and methods of this 
field study, the persisting changes strongly imply that the training design induced the 
changes. This report also Suggests the value of a design element to help reinfoKe change in 
programs of organization development. In this case, a mild reinforcement sessmn was held 
about one year after the initial training. The research design underlying the report is 
described as Oi, X, O2, O3, O4 which- is a modified time-series design witlj^an experimental 
treatment preceded by a single pre-test and followed by multiple post-tests. While various 
inadequacies of the research design were identified, the results indicated that the training 
design helped induce and sustain major changes in a large number of measures of the 
interpersonal and intergroup styles of a small organization unit. 

21. Maier, Norman R.F., Salem, Allen R., and Maier, A., Supervisory and Executive Development 
- 4 Manual for Role Playing, New York, John Wiley and Sons, 1957. 

This book provides two aspects of skills practice. The first aspect permits role-playing 
which is a method that furnishes an opportunity to practice a human relations incident in 
a life-like setting. The second aspect is that of being a casebook. The cases provided 
incorporate conflicts, differences in Bower and responsibility, and preictical considerations. 
This approach invites practice in disfcussing and analyzing crucial issues. The case-study 
approach assumes group discussion and the cases are sufficiently involved and detailed to 
produce a wide range in opinion concerning: (a) who was to blame; (b) what caused a 
person's behavior; and (c) what is the best corrective action to take. Role-playing allows the 
person to gfve insight into some of his relationships with others by having him play the 
role of those other persons. The specific values of the case-study approach and role playing 
are Identified. 

22. Byars, Lloyd, and Crane, DonaJd P., "Training by Objectives — A Comprehensive System for 
Evaluating Training Programs," Training and Development Journal, yo\. 23, No. 6, June^ 
1969, pp. 38-41. 

The article presents some techniques for defining objectives and a simple model for 
evaluating the effectiveness of training. The following criteria is considered as a guidepost 
' in defining objectives: 

1. Training objectives and corporate ^oals must be compatible. / 

< 2. Objectives must be realistic. - - 

3. Objectives should be clearly stated in writing. 

4. Results'should be measurable and verifiable. 

"Two basic areas of training must be distinguished in writing training objectives. The first 
afea deals with the development of skills. The second is the development of knowledge", 
understanding and attitudes. Various levels of learning are identified in each area. The 
levels of evaluation are: ^ - 

1. Internal evaluation which occurs while the course is still in progress. 
I 2. Immediate evaluation or end-of-course evaluation. 

3. Intermediate evaluation Vhich takes place sometime after the course is completed v 
and ^ittehipts to determine the course's effect on attitudes, behavior and skills. 

4. FihaF evaluation measures changes in performance. 

Various techniques are examined with respect to each level of evaluation. 

23. Bradford, L.P., and Lippitt, H.^ "Role-Playing in Supervisory Training,'* Personnel, Vol. 2^, 
No. 6, May 1946. ^ 

The role-playing method, adapted from the psyschodrama' and ^cio-drama techniques ' 
. enables participants to act out spontaneously the problems facing them. New insight is 
gained into, employfe^ motives and attitudes, ^nd opportunity is provided for constructive 
practice in typical, situations. The article provides a case study' of the role-playing training 
program and discusses fundamental aspects of the method. Those aspects are: 
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1. Getting top management involved in the training process. 

2. The involvement of all levels of the organization hierarchy in the training process. 

3. Organizing three-or-four-level training to facilitate communication. 

4. Taking a problem census to involve group members in identifying major areas of 
concern. 

5. Classifying problems into major areas. 

6. Role-playing to clearly identify problems. 

7. Diagnostic discussion of role playing situations. 

8. Role-playing as solution-making to test new ways of handling the problem. 

Skill in using role-playing lies in four areas: (a) the selection of scenes to be played and the 
setting up of these scenes to dramatize important points; (b) cutting off the scenes after 
major points have been played; (c) focusing the discussion on the major points; and (d) 
setting up other scenes growing out of the original diagnostic sets. Other u^es of 
role-playing include: role reversal; exploration of a variety of roles; and anticipatory 
role-playing. ^ . * 

24. Green, Thad B., and Cotiar, Morton, "A New Dimension in Management Training: A 
Video-Audio-Participative System", Training and Development Journal, Vol. 24, No. 10, 
October 1970, pp. 22-27. 

This article first describes an approach for achieving better management. The 
video-audio-p^rticipative (VAP) system is a combination of several video and audiO' 
teaching metjhods and learning resources including participative elements which promote 
active participation in the learning process by every learner. The aim of the VAP system is 
to improve the quality of the learning experience. Management theories and concepts are 
chosen which are most applicable to the needs of the learner. The system is designed to 
reinforce the student;^ understanding of principles and concepts. This is accomplished in 
two ways. Students engage in simulated experiences, and, students continually respond to a 
variety of stimuli including filmed incidents and objective questions, with the aim of 
generating' thinking and probing analysis. The VAP technique is a systems approach for 
learning relevant material in a relevant format and is designed for intense participant 
involvement in the learning process. ' 

25. Un(ierwood, William J., ''Evaluation of Laboratory-Method Training", Training Directors, Vol/ 
19, No. 5^May 1965, pp. 35-40. 

This is a report on an exploratory study to determine: 

1. W^her a sensitivity training course conducted by the T-Group Method would 
produce a change in the job behavior of its participants; 

2. What Jkind of change would be produced; and 

* 3. Whether change could be measured by the use of untrained observers; job associates 
of the participants. 

The report concludes that it is feasible to lYieasure job behavior effects of T-Group training 
by the use of work associates as untrained observers. When assessed in this manner, it can 
be hypothesized that T-Group training will: 

1. Produce behavior change perceptible to others; 

2. Produce greatest changes in interpersonal interactive situations; and 

3. Produce change, the incidence of wVu^ will be cumulative with progress of the 
course and will diminish after termination of the course. 

26. Robinson, Joseph A., "Videotape in Training" — Some Limitations and Criteria to Help Select 
Its Best Application," Training and Development Journal, Vol. 22 No. 11, November 1968, pp. 
15-17. ' ^ 

The article attempts to address the question of ^how a training director can choose and use 
videotape to make it a solid, permanent part of his professional resources. It indicates 
source limitations, strengths, and guidelines for use. Its limitations relate to 
mis-application, quality of the end product, and equipmerit incompatibility. Under 
misapplication, videotape cannot make judgements regarding right, wrong, go^d, etc. If 
quality is noticeably inferior in content, staging or reproduction, the viewer may -be bored 
" by, or prejudiced against the message. Its strengths are: relating observable behavior. and 
providing a setting for objectivity. Playback can allow an analysis of complex situations, 
allow a large audience to view the experience,' and allow for personal involvement to 
facilitate chan^;c among participants* 
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27. IJoser, John A., Simulation and Society: An Exploration of Scientific Gaming, Boston: Allyn 
^nd Bacon, Inc., 1969. 

This bopk is designed to introduce social scientists to simulation and gaming. It examines 
the history of simulation, discusses their theoretical and philos^phieai underpinnings of 
simulation an<^, gaining. The book also analyzes some )of the strong and weak points of 
simulation arid gdmmg, deals with questions of validity and usefulness within a variety of 
contexts, and tries to project some further directions for the field. 
• The nature of simulations and g^mes in general is considered. The author examines the 
philosophical and epistemological foundations- of social Science games, and traces their 
intellectual and historical roots. It was emphasized that whereas several intellectual 
streams, including small group experimentf^tion, decision theory, and system$ analysis, all 
have fed ihto the mainstream of simulation work, the use of games and simulations has 
grown from its genesis in war-gaming, in parallel but unrelated ways in several fields. 
These fi^ds include management training, economic modeling, political and international 
relations studies, sociology, psychology, and education. In Part II, the author analyzes why 
simulations and games are used. The utility of simulation and games as theory building 
devices, their roles in research, tfteir contribution to training and education, and their 
validity are^ analyzed. 

I ' • 

3.3 Health Maintenance Organisations " ' 

3.2.1 Content Areas 

The criteria for inclusion of articles in the HMO section of the state-of-the-art review is a content 
analysis of the following points: 

• R^vance to health maintenance organization philosophy and concern. 

1. Does the literature identify key HMO concepts? 
. 2. Does the literature discuss the philosophical « ba^e of health maintenance 
organizations? 
) 9 Relevance to provider orientation arid concerns. 

1. Is the question of changing roles for providers in HMO settings addressed? - 

2. How have providers expressed concern over impact of HMO programs on their 
functioning? Are solutions identified? 

3. What orientation and information programs for providers have been developed. 

• Relevance to quality of care issues. 

1. Are issues around quality <jof care in HMO's identified? 

2. Are solutions to the problem of determining quality of care and improving quality of ^ 
care provided? ^ 

• Relevance to HMO service delivery systems. 

1. Are HMO service delivery systems described in detail? 
' 2. Are organizational structures identified and discussed? 

• Relevance to HMO marketing issues. ^ 

1. Are key issues in enrollment • and other marketing procedures and solutions 
identified? 

2. Are patient complaint systems described? 

• Relevance to HMO financing. 

1. Are ngiechanisms for financing HMO's described? 

2. Arje clients rights and responsibilities for utilization described? 

3. Is the issue of utilization and costs addressed? 

Case studies of less than five pages were usually excluded. An article, book, or study for which a 
positive feaponse was given based on onie^or more of the questions in the above sub-headings was 
included. " r ^ ' ^ ^ , 

The, following articles in this section have been classified by their relevance to the following six 
are;as. Each article has a reference to^he particular pertinent area: 

(1) HMO Philosophy and Concern ^ ' (4) HMO Health Service Delivery System 

(2) Provider Orientation and Concern (5) HMO Marketing 



(3) Quality of Care ' 15 '^ ™^ Financing 
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1. ElKvood, Paul M., ^'Health Maintenance Orgfciization — Concept and Strategy,'' Hospitals, 
Vol.. 45 No. 6, Marcti 16, 1971, pp. 53-60, 67-76. (1) - I 

The author discusses health maintenance strategy and implications for hospitals and 
physicians. He identifies th^ assumptions behind the HMO concept: (a) the fipderal 
government as an initiator "of change; (b) the health care crisis resolution through 
structural apd organizational changes; and (c)-. federal health policy fostering, in the 
^long-run, self-regulation in the health industry. Two models of service delivery are 
described: the group practice model, and the individuaF practice model. A detailed 
description of HMO components and rationale are included. Descriptions of several HMO 
prototypes are provided: Kaiser Foundation; Health Insurance^Plan of Greater New York; 
San Joaquin' Foundation for -Medical Care; the Columbia Medical Plan; the East Baltimore 
Medical Plan; and Health, Inc. ' 

2. Havighurst, Clark C.l^ "He^h Maintenance Organizations and the Market for Health 
Services, 'Xhw and Con%rnp(%Lry Problems, 1970, pp. 716-795. ( 1) 

This paper is addressed to the policies needed to obtain the best possible implementation of 
the HMO concept. The ultimate thrust is toward detailing the policy choices necessary to 
create a market-oriented system of health care delivery, with HMOs as an e8sentia(l 
element. These are: ta) a multitude of legislatively and professionally conceivjd and 
executed trade restraints "have previously prevented the marketplace from functi(^ng up 
, to its potential eff^tiveness, andjhj^that restoration of a market regime offers the best 
Mpe for solving the nation's health care problem in all of its numerous dimensions. The 
foirus is on implementing the HMO. concept in the context of a federally funded scheme 
covering the poor atid the aged. A description of benefits that the market, supervised and 
supplemented by selective regulation, would be-able to deliver is incluHfid. The model is 
then evaluated in the light of concerns about emphasizing the profit motiWinhealth care 
and about monopoly tendencies in the health care marketplace. The final rec^nrnmda t ion 
^ is vigorous antitrust enforcement, explicit federal pre-emption of restrictive, state la^s and 
a number of other policies designed to assist in recreating an unrestrained competitive 
market for health services. 

I 

CSV • V " ' 

3. Mac©cd, O.K. and Prussin, J.A., "The Continuing Evolxition of Health Maintenance 
Organizations," Neu^ England Journal of Medicine, 288;439-443, Mlrch 1, 1973. (1) 

Of^the various health-care systems, health maintenargjj^ organizations most closely meet 
^ the objective of providing access to high quality comprehensive medical and health care 
service!^ at the most reasonable costs possible. Preventive services, early disease delation 
diagnosis, and treatment of illness and injury are all equally emphasized in the HMO. 
Basic principles for developing an effective HMO include 'prepayment; a contractual 
responsibility; integrated services; an^voluntary enrollment and comprehensive coverage, 
physicians' organizations; .physicians' payment influenced by shared financial 
responsibility; int(S?grated services; and voluntary enrollment and comprehensive coverage. 
An emphasis is placed on the need for both primary ^physicians and ancillary health 
persons working as a team to provide comprehensive care. 

4. Myers, Beverlee A., "Health Maintenance Organizations: Objectives £md Issues," paper 
presented to State CHP Agencies Annual Conference April 7, 1971, Washington, D. C. and 
published in HSMHA Health Reports, 86:585-591, July 1971. (1) 

The objectives for health maintenance organizations are focused on providing investment in 
and incentives to use prepaid and organized comprehensive health care systems Serving 
defined populations. The objectives are: (a) to offer alternatives to the existing^^health care 
system; (b) to reform the system by bringing greater organizational efficiency together with 
more effective control of quality of care; (c) to introduce cost control through, incentives 
within the delivery system; and (d) to provide incenti^s for health maintenance rather 
than crisis oriented medical care. 

The quest of what is an HMO.fs discussed with emphasis on the necessity of having all 
elements present and active. These 4|^jBments are: ^ 

1. An organized health care delivery system which includes healjth roanpower and 
facilities capable of providing or at least arranging for all the health services a 
population might require. ^ O 
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2. An enrolled population consisting of groups and individuals who coatract with the 
delivery system for provision of a range of health services that the system makes 
available. 

3. A financial plan which incorporates underwriting the costs of the agreed-upon set of 
services on a prenegotiated and prepaid per person or per feimily basis. 

4. A managing organization wJbich assures legal, fiscaVf public andLH??^fessional 
accountability, (/ 

Issues of provider acceptance, consumer acceptance", and coexistence of prepayment and 
fee-for-service systems are discussed. 

Freidson, Eliot, "Prepaid Group Practice and the new 'Demanding Patient'," Milbank 

MembrUd Fund Qumierly, Vol. 51, Fall 1973, pp. 473-489. (2) 

B^sed on an extensive field ^ study of the practitioners in a large, prepaid service contract 
group practice, this paper discusses how a prepaid service contract and closed-panel 
practice brings a new dimension into doctor-patient relations and the response of 
physicians. Unable to manage' "unreasonable" demands for service by use of a fee-barrier or 
encouragement to "go elsewhere" as in traditional, solo fee-for-service practice, physicians 
were particularly upset by a new type of "demanding patient" who claimed services on the 
ba§is of contractual rights and threatened appeal to highef^fem-eaucratic authority. Modes 
of dealing with such patients ai^e briefly discussed. One mad^v^^^to provide all services 
covered by the contract which were not inconvenient to the practitioner- office visits, 
referrals, and laboratory tests. The physician or gate keeper to the benefits can determine 
patient utilization of those benefits. Another strategy was one of the expert consultant who 
useo^^l^ia^er medical knowledge and' skill to limit access of the demanding patient. And 
finally, a^strategy of patient education and the development of a trusting relationship can, 
also be used to cope with the demanding patient. . / 

Brook, Robert H., "Critical Issues in the Assessment of Quality, of Care and TJ;^ir 

Relationship to HMO's," Journal of Medical Education, Vol. 48, No. 4, Part 2r 1973, pp. 

104-134. (3) . • . 

The purpose of the paper is to examine the relevant components of the quality of care issue 
especially as they pertain to the medical care received by enrollees of prepaid group 

^ practices. The specific objectives are: (a) to discuss problems with' the definiticjin and use of 
the words "quality of care," (b) to present the different methods of assessing quality of care 
and to illustrate their weaknessess and strengths, (c) to summarize the literature 
concerning ^he quality of care received by people enrolled in prepaid group practices, and 
(d) to suggest future ar^as of research. ; ' 

Donabedian's classification scheme is used to analyze different types of data for assessing 
quality of care: (a) structure assessment, which includes input measurements, such as the 
number of health facilities available or the ratio of physicians to population served; (b) 

^ process assessment, which includes the physician's technical and socio-ec.onomic 
management of health and illness as well as aspects of the patient-doctor relationship; an^ 
(c) outcome assessment, which includes what happens to the patient in terms of his 
symptom level, major activity level, whether he is still living, and how he functions in his 
community. 

It is concluded that little is known about tjie quality (ff medical care in general, let aione 
aboi^t care received by enrollees of a prepaid group. 

Morehead, Mildred A., "Evaluating Quality of Medical Care in the Neighboriiood Health Care^ 
Program of the Office of Economic Opportunity," Medical Care, ^ol. 8, No. 2, 1970,, pp. 
118-131. (3) 

Twenty-four OEO Neighborhood Health Centers have been audited to determine the extent 
to which selected criteria were met in the fields o^ adult medicine, infant care, and 
obstetrical care. Two types of audits were used in the reviews: one based^on the index 
approach to auditing, the balseline surveys; and the other, using the peer judgement 
approach, the clinical audit. Principles of group operation* sample^ selection, the scoring 
process and findings are presented. The centers were ranked by their scores and various 
characteristics Were* examined. Program design, patient volume, fnedical school affiliation 
and, most important, administrative know-how were concluded to be mayor, factors 
associated with high performance ratings. 

* 
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8. Barr, Daniel M., and Gaus, Clifton R., "A population-Based Approach to Quality Assessment 
in Health Maintenance Orgaaizations," Medical Care, Nov.-Dec. 1973, Vol. 11, No. 6, pp. 
523-528. (3) ' 

The conceptual basis for an approach to quality assessment is presented. Thjs approach 
focuses on the accessibility, efficiency, and effectiveness of tl^e system for providing care 
rather than of detailed characteristics of the care itself. The approach currently being 
developed at the . Columbia Medical Plan in Maryland can be characterized as 
population-based and multidimensional. Population-based is defined by the inclusion of 
^.accessibility or a dimension of quality. It is multidimensional because of the inclusion of 
three of the many dimensions of quality. The approach is intended" to be an on-going 
regular quality assessment procedure for an HMO which would be dependent on, and 
integrated with, clinical and administrative marmgement information systems. 

9. Hirsch, Gary S.M., and Miller, Sutherland" . "Evaluating HMO Policies With a Computer 
Simulation Model;" Medical Care, Vol. 12, No. 2, August 1974, pp. 668-681. (4) 

The development and design of a computer simulation model of a health maintenance 
organization is described. Simulation models permit experimenting with policy changes 
without the risk of actually making m^gor alterations. The data for this model came from 
applying it to the issues facing a Children and Youth Project considering conversion to an 
HMO. To illustrate the models usefulness, simulations are presented showing the imHiact of 
different marketing approaches, bene^b^ackages, and fitness programs. The model was 
designed to address a number of specie issueg. These included: 

1. What resou4-c^Tgwls.ar(5;prequirfid to provide a gi\|en level of service? 

2. What levels( of servlqe fe^ix^ements can be \pxpected with various subscriber 
population mV'es? : v 

3. How will th/xfaults of different mark^^g grfi^rams/^al^ct the subscriber mix and 
the financiatt Nng^lity of the HMO? " 

4. To J§f^at ^^^^ can the delegation of tasks to paramedical personnel effect the 
overa^coj^^or care delivery? 

5. Wh^^^e the advantages and disadvantages of a marketing program with heavy 
^ emphasis on Medicaid and Medicare populations? 

6. What sets of population mixes and premium levels may make the HMO unattractive 
to the relatively healthy employee groups? 

* ' 7., How vwll various facilities, resources, and policies affect the HMO's costs and levels 

of service? 

8. To what extent can screening and fitness programs affect the over-all costs of care? 
The results of the study supported its usefulness in analyzing the lopg-term consequences 
of policies and decisions which affect the HMO. 

y 

Iff. Health Systems Research Program-Bionetics Research Laboratories, Inc., Marketing of Health 
Maintenance Organization Services, Vols. I through V, U. S. Dept. of Health, Education & 
Welfare, Health Services and Mental Health Administration, Health Maintenance 
Organization Division of Training and Technical Assistance, February 1972. (5) 

This series of volumes explains and develops a methodological approach to the marketing 
process. Volume I (Guidelines for Health Maintenance Organization Marketing) 
summarizes a general approach to developing and implementing a marketing program. 
Volume II (Th© Beneficiary Population) includes information and data requirements for the 
beneficiary population which are used as the foundation of a responsive marketing 
strategy. Volume fll (Existing Systems and Services) defines those characteristics of th 
existing health intermediary and delivery systems which should be considered 
developing a 'cpgent| marki^t strategy. Volume IV (Market Definition) focuses oir^e 
foundations on Which^^ to develop a logical and phased marketing approach- and 
Volume V develops a marketing strategy and model. A * ^ ' 

11. Schenke, Roger S., and Spicer, Curtis J. ^ cds. /Development of HMO s Within Existing Group 
Practices - A Symposium Jointly Sponsored by the American Association of Medical Clinics 
and the Medical Group Management Association., American Associatic^ of Medical Cli'aics, 
1973. Also in Medical Group Management, Vol. 2l> No. 1. Dec. 1973, pp. '22-24. (B-1; B-2; B-5; 
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HMO developers in five member group practices served as the symposium panel. The 
symposium focuses on HMOs as an integral part of fee-for-service group practice. The 
panels were? 

1. Introduction to the clinics — a brief overview of the fiW participial;! ng clinics; 

2. Why start an HMO? — an attempt to answer the q^e^tion/of the rationale for 
developing an HMO; ^ <^ 

3. Legal structure — questions relating to existing and proposed legislation and 
regulations impact on HMO's were addressed; 

4. Component linkages — the role of physicians in provtding and linking the various 
service components of HMOs; 

5. Benefits and health services — examples of how to design and negotiate the benefit 
package dre provided; 
Risk sharing issues; 
Marketing plans and problems; 
Management issues and organizational structures. 

eneral sharing of information and issues is the format of the synlposium report. 



Jeffrey A., "HMOs — Organizational and Financial Models", Hospital Progress, Vol. 
1974, pp. 56-59. (4, 6) 

article discusses the organizational and financiaP structures of three prepaid group 
practice plans — the Community Health Care Center Plan, the Group Health Association, 
and \he Health Insurance Plan of Greater New York. The brief descriptions of each plan 
provide useful care materials for training on functional and operational aspects of health 
maintenance organizations. The two fairly dissimilar models of HMOs are identified. One is- 
the medical care foundation which has the following elements: 

1.. Prcepaid health plans; o 

2. Participating physieians remain in their previou3 fee-for-serviCe solo or group mode 
of practfce and bill the foundation for /nember services on a fee-for-service basis. The ^ 
physicians incur risks insofar as they must a^fcept lower fees for. service if utilization 
is higher than anticipated; 

3. Some form of peer review; 

4. Review of hospital Utilization rates; 

5. Com prehensiya_£0 vera ge, including inpatient, ambulatory and "health maintenance 
services; and 

6. Free choice for patient between the medical care foundation and indemnity plans. 
The other model is prepaid group practice. The elements contained in the model are: 

1. Prepaid health plans; 

2. Physicians organized in a multispeciality group that should be autonomous, 
self-governing unit; 

3. Peer review; . , 

4. Risk sharing; 

5. Plan makes available all ambulatory and in-patient facilities that are necessary for 
the provision of comprehensive health care services; * " 

6. Coverage is comprehensive including inpatient, ambulatory', and health maintenance 
services. Preventive medicine as well as early detection, diagnosis, and treatment of 
illness and injury are stressed; and ' \ ^ . 

7. The individual has ffee choice among the physicians participating in the plan as well 
as between prepaid group practice and indemnity plans. ^ 

13. Division of Training and Technical Assistance of the Health Maintenance Organization 
Service, Financial Plahning Martual.XiS DHEW, HSH]ytA-(6) 
- The focus of the manual is on the presentation of' certain procedural information that will 
assist in sound financial planning for the establishment of a prepaid health care plan. It 
presents a structural approach for identifying major plan parameters that have impact on 
costs and resources, as well as a set of procedures for organizing and analyzing the major 
financial characteristics of the plan. Specifically, procedures Sre presented for: 

1. Developing in a stnictured^format the costs to be incurred fcy the plan; 

2. Evaluating the impact that various plan parameters have on the overall costs of 
HMC^ctivity; 
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3. Developing a revenue structure that is sufficient to offset plan $5O0ts and support the 
growth objectives set by the HMO sponsors; and 

4. Determining the financial commitments necessasy to start-up and sustain the 
operation of the HMO. 

The manual also contains utilization and financial data that wer^ collected from various 
existing HMO activities. This manual is a 'guide for thfe pltoner that v/ill assist in the 
development of a clear understanding of the plan's financial requirements and expected 
atctivities. ' 

14. Shalov/itz, Mervin, and Trotter, S. Allan, 'Intergroup — One Alternative, Part II, Benefits, 
Roles, and Marketing," Medico/ -l^roi^p Management, Vol. 21, No. 1, pp. 26-28, and "Intergroup 
— One Alternative, Part III, Management," Medical Group Management, Vol. 21, No. 1, pp. 
21-22. (6) ' ^ ' 

The articles provide information on benefits, rates, and marketing for 'the Tntergroup 
Prepaid Health Service Plaiv. Intergroup provides a comprehensive prepaid' health program 
through a group Subscriber population utilizing the services of 20 multispeciality medical 
groups in Illinois and Northern Indiana. Each group provides services through both a 
fee-for-servipe and capitation modes. The groups greatest problem has b^en educating the 
public as to the benefits available as well as the concepts which ^re inherent in the p^^paid 
format. The copayment feature has been a plus factor in marketing. The success of th<^pian 
has been due to active participation of physicians in the management of the plan a^^^^sll^S 
in designing the benefits package. In Part III, Management, the physicians have tounJl;^ 
the plan allows them to be totally obligated for patient care and reduces the conflicts 
^ between physicians and third-party payors. ' ^ 

For members, the stress on preventi\l'^ and maintenance care allows 'them to budget their 
medical care on an annual basis. ' 

15. Thompson, David A., "Financial Planning for an HMO, Health Services Research, Vol. 9, No. 
1, Spring 1974, pp. 68-73. iB-S) , 

This article discusses the development of a financial simulation model |br HMO's which 
j could be developed into a training instrument. The model was designed to be Sufficiently 
realistic in representing the anticipated situation to allow reasonably acr«'f^3%t^-j>laiUHng^ 
but not so complex as to be incomprph^^nflihle' to those involved in the forecastitig.^ TBe 
simulation model was evaluated as a highly successfW jnethod of deteminiiig ^he financial 
trade-offs" of various health delivery rated decisions. In developing -the simulafioKTrnode 
' the "more rigid" parameters (less influenced by HMO*s actiphs) v/ere initially asaqmctd tp 
be the "independent variables": monthly health insurance premiUiijs^^inaxin^^ market, 
' interest costs, and outsid§ service costs. The m"or^ cQntrplIable ^ de^tendeftt parameters 

w^e: monthly growth rate for each potential plan, HMO operatmg^ e^CE^^ (assumed to 
have a fixed and a variable component), and the share of total premiuniSI^Biyoe retained 
by the HMO for its administrative services. The model was developed on a^, interactive 
''program, written to permit qiembers of the HMO maafiigemeBt "team , to *'play with^ tiie 
♦ parameters to see which were the more sensitive ones and what various balances of ya lues 
constituted feasible solution. The "goodness" of a solution was measured by its resulting 
maximum jieficit and the length of time required 4a3:^the JMO to break etJ'en. \ 



4. TRAINING IMPLICATIONS 

^ \ 

Thia paper hte^ reviewed literature relevant to team training in health maintenance 

org^nizatioita. The concluding section will fecu§ jtmplications for curriculum design and 

4iir2|)lementatioB. Section 3 is divided, in iigfet of the preqj^diag section on the literature review,ilrto: 

<a) t^om training and curriculum development; and, (b> health maintenance organizations' literature 

and curriculum developmeBt *• — ^ 

4.1 Team Training aiid Curricultim Dearelopment 

"^"^W training literature's relpvance to cuiTicul)um development is evident in the three areas of 
methodology deai^, ftvppn<pfiteifk^^ig?3~ag ^^ The bo ok by Havelock and Havelock provides 

a fcegiiining HUdemtending and fraBie^ork -for designing ^training programs." From theoretical 
conmderatioms to go'fir^fifetting, program design and evaluation, this book can serve as a useful tool 
•and model for curriculum design. The ^ articles by Nagi; Carlaw and Callan; World Health 
Prgamzation; jPiedeoni; Rubin snS ^^^ckhard all inclu4e discnssion of methodological considerations 
wMeh ar© p^rtisijgKit fco curriculum desigi^, Books by Fordyce-Wesley; McTeenan and Hawkins; and 
Odiome provi^^ in-depth analyses of methodological issues and training objectives. 

Tfee specific techniques of role-playing, simulations and games, T-groups, audio- visual materials 
and general teaching methods are diESUs^ed and, in some instances evaluated, by the following 
authors. 

Issues around role-playijxg are identified and discussed by Maier, Salem and Maier; and Bradford 
s»d Lippitt. The values of simulation and gaming are discussed and evaluated by Roser. Laboratory 
groups are described and evaluated by Hall and Williams; Buchanan; Golembiewski; and Underwood. 
The use of audio-visual materials is/ discussed by the U. S. Civil Service Commission's article on 
Visual Materials; Green and Cotl^r; and Robinson. Other teachings methods are discussed ai^d 
compiarpd^ within the context of the^^^figre mentioned articles. Specific emphasis on evaluation of 

^ training methods is provided in the articles by Baird; U. S. Civil Service Commission's Training 
Evaluation; Petty; Rubin and Beckhard; Bolman; Byars and Crane. Several evaluation models are 
also considered iir^the boolts listed under the methodology area. 

_ Several reewring themeS were presented in the literature review under methodology .and 
evaluatipn^ifey^iolQ^^l^ tended to focus on: (a) clearly defining training" goals and . 

objectiv^tb) theXlse of tramH^g techniques, methods and aids ^hich are appropriate to (he trainees' 
comprehension levfel and the trainem* skill level; and, (c) an evakiation which is designed to test the 
effectiveness of the training program with particular emphfiigis ori measuring the sustained change in 
trainee behavior. ' «^ 

4.2 H^illlrMaiiitenance Organizations Literature and Curriculiun Development 

Several broad areas wet-e^nsidered in reviewing health maintenance organizations literature 
4nd its relevan^ to curriculum development. These areas were: 

in) Melevanee of literature to HMO philosophy and concerns. 
^. ^ (b) Relevance. to provider orientation and cl5?rcerns. ' ' 

(c) Relevanca^tp quality^ care issues. 

(d) Relevance to"l!MO service delivery systems. * 

\ (e> Relevance to HMO marketing is&ues. * 
(f) Relevance to HMO financing issues. 
Authors focusing on HMO philosophy were EUwood; Haviglmrst; Myers; Morehead; and Schenke^ 
and Spicer. Their m^or emphasis ^tf^ on identification of the ConCeptual basis of HMO legislation 
^^jmd implementation issues. iProvider conconis were^overed by Schenke and<!prtis; arid Freidson. The 
niajor ^ml>hasi8 was on the impact of tlMSS^Ofl^^r^^^p^ and the demands for services by 

patients and^ thtrd-part}?' payors."^tiality of care isstr6^ were identifiedTSy "Brook; Morehe^; and Barr 
^nd Gaus. The ynde%ing theme was the difficulty^ developing a meaningful measure of tfuaTfty of 
care in prepaid settings. Some possibl^i solutions to th^ problem were identified. However, the need 
for further research was stressed. HMO d^ivery systems were described by Prussin^ Hii^sdb, and 
Millet? PrussWs article was piirely descript^w^-^^irscii and Miller provided an example of a computer 
simulation which can seA^e as a useful platming tool to develop a delivery system. The literature on 
rtjajketing issues was limited to th^ Schesifea and Spicer article and the Health Systems ^manual.-. 
' Sche^tal: and Spiogr identify some practice is^u^ in marketing. The manual outline^^the ideal 
-marketing f:i^cess. HMOs and financial planning issues were discussed in Scherike arid Spicer^ 
Prussin; ShalowW Thompsi^; and tiie HEW financial plannirrg pianual. Thele- articles provided 
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information on HMO financial planning problems, :Bimulation models, and manuals for planning. The 
content in these six headings should be integrated into the curiculum since they highlight some 
msyor HMO issues and in some instances offer solutions. " 

4.3 Implications 

Pased oxKthp literature review, there are several components that should be present to insure a 
successful triHning program. First, the goal and purpose of the training design should include a 
definition of trainer roles; specific training problems or needs identification, and an indication of 
training limitation^. Second, the specific training needs of potential participants should be identified. 
Conflicts with their needs and program objectives should be> resolved. Third> the anticipated training 
outcomes should be stated. Three^areas of outtome focus^hould be clarified and elaborated^ 

1. Attitude and value outcomes; . - 

2. Knowledge outcomes; and ^ * ✓ 

3. Skills outcomes. - ' 
Long-term butcomes should also be included in the section. 

Fourth, the training prgcedure should be delineated to include: (a) the traihing schedule; (b) 
train er and trainee preparation; (c) readings and audio-visual aids; (d)^^utline descriptions of each 
tmming'tmii, delineating team building processes and HMO content; kncj finally, (e) the criteria for 
evalu§i:tion should include measure of process and fepntents impact both initially and over time. 
Alternative measures of. training effectiveness should b§ designed to support the evaluation' 
component. A system for feedback "and use of evaluation -data should be developed tp increasj^ training 
effectiveness. t - ■ j 

Further research needs to occur in the area of training methodologies and evaluation. The 
. training gfection in this paper only begins to identify key concepts, issues and designs. 

While the HMO section search was quite extensive, published materials relevant to curriculum 
design for a team training program were scarce. As HMO experiences increase, it is anticipated that 
there wilt be a greater body of knowledge from which training and learning can occur. 
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INTRODUCTION 

This manual* is Appendix 4 of a final re|K)rt prepared by the Detroit Medical Foundation (DMF) 
in compliance with DHEW Contract No. l-MB-44196*. The purpose of this manual is to provide 
Individual Practice Association (IPA) model Health Maintenance Organizations^ (HMOs) with a 
training program manual design which may be developed to facilitate the transition of medical, 
para-m(gdical and other health orofessionals into an IPA model HMO setting. Secondly, it provides a 
description of Michigan HMO^^lans, Inc., the only (IPA multiple group practice model HMO) DHEW 
funded, (feve^ment grantee in the State of Michigan. 

The con^Rt title "'Deomonstration Training Program to^dnprove the Capacity of Primary Care 
Unit Staffs to Function within an HMO Setting" (DTP) was awarded ttf the DMF July of 1974. . . 
Primary Care Unit Staffs . . (PCU) referred ta in the^ntract title are the staffs of the contract 
health services provider groups of Michigan Health Maintenance Organization Plans, Inc. (MHMOP). 

We recognize that lio guide is complete, however, t\\e DMF contract fetaff feels that this manual 
can serve as a valuable guide to other IPA model HMOs that are interested in^eveloping training 
programs of this nature. » ♦ 




"DiviHion of Adsociated Health Profeasions, Bureau of Health Manpower iBHM), Health Resources AdminiBtration iJiRAi, Pubhc Health Service 
iPHSi, Department of Health, Education and Welfare (DHEWi 
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WHATISANHMOr 

The Health Maintenance Organization , most commonly refer^ to by the letters HMO, has 

^ h' * . 

.become a frequently used e;:pres8ion in th<f health field. For most neople, a common reference jx)int'is 

the Kaiser Permanente Medical Program which h£is operated aa am HMO type health delivery system 

since the early 1930'8. But what is an HMO? In December of 19^4, the HMO was defined by Public 

Law 93-222 (The Health Maintenance Organization Act of 19^3). This legislation provides a more 

detailed definition of what an HMO is, and how they may be established. Final rules and regulations 

which provide the guidelines for establishhig HMO^s were finalized in'^October of 1974- '"^ order to 

stimulate the devetcrprfieat of.HMO's, the federal government appropriated avef^^O million dollars 

^^^or grants, contracts and feasibility surveys for groups that would organize to establish HMO delivery 

systems. 

4 • 

SOME CHARACTEI^ISTICS OF HEALTH MAINTENANCE ORGANIZATIONS 

No doubt the most obvious question relative to the HS^OJs "what is the basic difference between 
an HMO health pl&n and a traditional indemnity insurance plan." The answer is that an HMO plan 
actually provides medical care and other health care' services to i^ members, while traditional 
indemnity insurance plans either reimburse its members for health services that they have already 
received or reimburse the providers of health services. Other aspects of the HMO that are different 

... X . ' , 

from msurance companies are: 



A. The Method of Payment ' 

^ayrpents (premiums) for health services by HMO enroUees must be based on a community 
rating system. While the Department of Health, Education and Welfare (DHEW) has not published a 
final policy on the interpretation of a community rating system, this system may generally be defined 
-as one that does not set rates based on the actual past health services utilization experience of a 
specific group. In other words, all individuals in a particular community would pay a fixed amount for 
its health services based on the number of persons in that community. In addition, this fixed payment 
is to be paid on a periodic basis without regard to the frequency, extent or kind of services actually 
furnished. Additional ncmiinal co-payments maybe required at the time of service except "whenever 
they act as a barrier to utilization." The Secretary of DHEW will establish regulations concerning 
barriers and the amount of permitted nominal co-payments. » 

17 2 

B. HMO Health Services 

If you enroll in an HMO, the HMO must make available to you the following services: 



1 





Basic Health Services'^ 

1. Phyokan cerviceQ (including consultant artd referral eervices by a physician). 

2. Inpatient and outpatient health services. 

3. "Medical ly-ixecessary emerger^cy services. \ 

4. Short-term (not to^tetsei^ twenty vi8lt&)> outpatient evaluative^^^B^^risia intervention mental 
health services. ^ 

5. Medical treatment and referral services (including referral services to appJ'opriate ancillary 
services) for the abuse of or addiction to alcohol and drugs. 
Dig^gnostic laboratory, diagnostic and therapeutic radiological services. 

lealth services. 

Home Health Services means services provided at a member's home by health care 
personnel, as prescribed'' or directed by a responsible physician or other authority 
designed by the HMO. 

8. Preventive health. services (including voluntary family planning services, infertility services 
preventive care for children and chilxlren's eye examinations conducted to determine the need 
for visual correction. (This includes preventive dental care services). 

Preventive Dental Care Meaus:* 
A minimum of — orafp 

as provided by regulations of the Secretary to children under the age 12. 




A minimum of — orarprohphylaxisr^Q^ical flouride ap^ttatioji^and surface sealant services 



p-' Supplememtair Health Servicesr 

These optional services, wliich may or may not be ofTered, include all or part of the f|)llowing: 

1. Services or facilities for intermediate and long-term care. 

2. Vision care not included as a basic health service under 1 or 8. 

3. Dental services not included as a basic health service under 1 or 8. , 

4. Mental health servicesTidtrincluded as a basic health service under 4. 

5. Long-term physical medicine and rehabilitative services including physical therapy. 

6. The provision of prescription drugs prescribed in the course of the provision by the HMO of a 
basic healtl\ service or supplemental health service. 

C. Enrollment in an HMO - (DUAL CHOICE OPTION)* 

Employers subject to the Minimum Wage Act, who employ twenty-five or more persons, shall 
include in any health benefits plan offered to employees the option of membership in DHEW qualified 
HMOs. No employer shall be required to pay more for health benencs than would otherwise be 
required by any prevailing collective bargaining agreement or benefit contract. 



*See "'Health Maintenance Organization Act of 1973" S. 14 173 
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D. Open EnroHijieat^v^ ^» \ * 

HMO© iQ^nnot diecrimij^te agamst enrolling*' high risk individuals or groups Ulricas it can^rove 
to^th© Secretary of BH1S.W ttoi its financial solvency is threatened by. doing so. ^ 

E. pFGviders of tll^ Health Services* 

Health lervicea provided by an HMO mmi fr^^irovided by qufiiH^ed health professionals. "Healthy 
pro^j^iona'ks, is defined as: physicians/dentists, nurses, podiatrists, optometrists, and such other 
individuals engaged iji the delivery of health services. Other operational requireoients of H^Os are: 
1. Piscf] viability^ ^ - ' . • • 

^. The re^poHilbility of Hfi^O for full financial risjc on a prospective basis for basic h^lth 
services, «x^^t4hat reinsurfitflip© may be obtained. / . 

• 3. EorolImeM of persons wMrfjI^^'broadly repres^uitatiVfe of tke communij/H^ serves. 

4. G^i^Wcping body representation for HMO enrolfe^s. * • — , 

5. A grievance procedure fof HMO members. ' ' 

C. A Qu&Ut^' ASsuranc^S^o^ram which emphasizes health outcom^naml peer review, 
* Medical Social Services pt^ded or arranged for. ' . ' ♦ 

" - ^. Contiriuiog educatfon for its health professionals. 

^. Maintain a monitoring system to evaluate costs, utilization patterns, availability of services, 
~ V accelSibilit^ of servi(^, and health status of ^rollees/^ 
The organizational structure of HMOs is specified ill the^HMO legislation. Essentially, there areJ:wo 
tj^es: ' '* ' , ^'-^.^ - ... 

1. The Staff Model or.Medical Grouti* ^^^^ 

By definition, a medical groilp ia defmed as a patternership, association, or other group which is 
composed of health professionals licensed \p practice medicine or osteopathy and of such other 
licensed heahkpVofeasioiials (including denUsts, optometrists and podiatrists), as are necessary for 
the provision of heal«^ si^rvices for which the group is responsible; a m^ority of the members of 
which arfe Jiceifeed'to practice medipne or oateopat%4 and the members of which: 

' 1. As th^ princrpa^4)rofessional activit^^ and as i^ group responsibility engaged in the 
coordinated practice of their profession for a health maintenance organization; 

2. Pool their incort^e from practice as members 6f the groUp and distribute it among themselves 
^ -according to a pre-arranged salary or drawing aCeoynt or other plan; 

3. Share medical and other records and substantial portions of major equipment and of 
professional, technical and administrative staff; 

4. UtiUze^such additional professional personnel, allied health professional personnel, and other 
health persahnel (as specified in tfegulatipns of the Secretary) as are available and appropriate 
for the efi^ective arii};^fricieht delivery of thd^^ervices of the members of the group; and 

5. A4^nge for and encourage continuing edtu:^^ field oRclinical medicine and related 
areas for the member?^ of the grOi^ -; ^ 

'*.S«' "Health Maintenance OrRani/ation Act of 1973" S 14 . ^ 7 4( 
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IL^The Individual PraclJce Association* ^ • 

* Am IiidiviS^al Practice Aasociation is defined as a' partnership, eo^^oration, aslod^tion, 6^f*-oUieE' 
legal entitj^ ^^hich ha§ entered into a service arrangement (or arrangements) with persons tJ^ho are 
licensed t6 pFaclice iOaediehie, osteopathy, dentistry, podiatry, optojnetry, or otljer health professions 
in a State and a majority of whom are Hcensed to ' practice meidjcine or osteopathy. Suc^ an 
arrangement shall provide: v , 

1. That such persons shall provide their professionefl a^rvicQS m accordance witb a cpmpepisation 
arrangement established by the entity; and. - • • - 

2. Ta^ the extent feasible: 

a. that such persons shall utilize such additional professional peciionnel, allied health : 

professional personnel, and other health personnel (as speciSed) in regulations of the 
i Secretary) as are available^ nd appropriate for the efiF^rfive and efficient delivery of 
the services of the persons who are parties to the arrangement; ' ' 

b. for the sharing* by such persons of medical ^nd oth^r records, equipment, and 
professional) technical, and administrative staff; and 

c. for the arrangement and encouragement of the contimiijrtg education of such persons 
in the field of clinical medicine and related j^as. 

Sponsors of HMO'^ generally fall into two cat^gorib^ — provider directed plans and consumer 
directed plans. They may also* fee for profit and non-profit. 

Michigan Health Maintenance Organization Pland, Inc. is a physician sponsored multiple group 
IPA Model HMO. It is also tax exempt under section 501(c) (4) of the Internal Revenue Code of 1954, 
as apnended. ^ » 

In summarizing the intent of the ^MO li^islation, it is essentially an attempt to impact the. 
organizational structure of the health delivery system and change the method.of payment. It is also 
an effort to malte comprehensive health services more available .and accessible to HMO enrollees, 
while at the same time, emphasizing the practice of preventive and maintenance health^re. 

While the above-mentioned changes^^^ the health care deli ve^f^ System does not guarantee the 
delivery ^of better quality health services, to date much evidence indicates that» together, the HMO 
^Uvery mechani^^n and pre-payment may be a step in the right direction. 

Per the HMO Program Status Report, May, 1975, **There are now 173 prepaid health care 
organizations acroSQ the country serving an estimated 5.7 million enrollees . . . Prepaid health care 
organiZatjpns are now operating in 33 states plus. D.C. and Guam . . . The top ten states, in order Of 
totarprepaid enrollment are: California, New York, Washington, Oregon, Wisconsin, Hawaii, Illinois, 
Michigan, D.C.^ and Minnesota. The states with no operational prejjaid plans are: Alabama, Alaska, 
Arkansas, Delaware, Georgia, Idaho, Iowa, Louisiana, Missouri, Montana, North Carolina, North 
Dakota^ Oklahoma, S^Mh Dakota, Vermont, Virginia and Wyoming. 

Insurance Gon^^anies, Consumer groups, labor unions, national and local Blue Cross, and Blue 
Shield organizations,'' banks, universities, industrial firms and others in the private sector are 
becoming increasingly involved in HMOs.** / 

♦vS«« "Health MatBtenance Organisation Act of 1973** S. 14 t 7 hi • 



PROPOSe6'CHANGES INTHE HMb LEGja^or4 

Although the evidence indicates that HMOs may be the answer to some of the nation*8^ health 
cieiiyeFy system problem, the Federal HMO Legislation TK/ 93-222) ha| been criticized for having 
structural defects. 

Proposed legislation to remedy these defects include: 

/ 

1. Reduce the mandated basia benefit package. 

2, Reduce the scope of mandatad benefits. 

a/ Remove a requirement relative to physician aggregate time with HMO enrollees. 

4. Remove tfee requirement that HMOs have open enrollment periods yearly. 

5. Redefine the^term 'TVI^dical Group." 

6. Removal of the Dual Choice Option. — 
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OVERVIEW OF THE MICHIGAN HEALTH 
MAINTENANCE ORGANIZATION PLANS, INC. (MHMOP) 

In May of 1971, a group of concerned inner-city 'physicians and consumers ^ntributed four 
Hundred ($400.00^ dollars in- seed money, and an immeasurable amount of time and effort, to 
establish the Detroit Medical Foundation (DMF); a 501 (c) (3) non-profit corporation. The objective of 
DMF was to plan and develop a HealTh Maintenance Organization (HMO) in the Detroit Metropolitan 
area. In the months that followed the initial $400.00 commitment, DMF applied to the Department of 
Health, Education and Welfare (DHEW) for an HMO planning grant.' In January of 1972, just eigh^. 
months aaer the formation of DMF, DHE^ demonstrated its confidence in the efforts-of DMF by 
awarding It $25,000.00 tojplan an HMO. Continued hard work and development efforts by the Bo^rd 
and staff of DMF enabled/them to obtain a continuation gra,nt of $70,000.00 in June, 1972. With this 
additional monetary resour^re, DMF began the initial stages of finalising its HMO plans and 
development activity. One year later, June of 1973, DMF was awarded a two hundred six thousand 
($206,000.00) dollar development grant from DHEWs Health Maintenance Organization Services. ^ 

Because of the Internal Revenue Code applicable to DMF andv^ requirements imposed by 
regulations governing the issuance of a Certificate of Authority by the State, to DMF, a new 
organizational structure was mandated. This rpandate caused the creation of Michigan^ Health 
Maintenance Organization I^lans, Inc. (MHMOP) a 501 (c) (4) rion-profit corporation on September 23, 
1972. It now serves as the operating implementation entity. for the health care delivery sys^^em v^hich 
was planned and developed by DMF. In addition to planning and .developmental funding, HEW has 
provided DMF and its operating agency, MHMOP, the expertise and technical assistance of a wide 
^ariety of consultants and organisations at no expense. 

In April of 1973, MHMOP submitted a proposal to the Michigan Department of Social Services 
(MDSS). This proposal requested that ^DSS contract with MHMOP to server 40,000 Medicaid eligible 
(Title XIX) persons in Wayne County. Much time and effort was expended, in negotiating the 
proposed contract with MDSS. This effort culminated with the signing of this proposed contract in 
December of 19731 ' . " 

In February of 1974 the first Title XIX recipients, via the MDSS contract, were enrolled in 
MHMOP. From February to the present time (November, 1975) the MHMOP Public Relations and 
^larketing staff have Exerted maximum efforts in educating the Medicaid market about ti;^HMO 
concept and MHMOP. As a result, MHMOPs present enrollment is 28,640. 

Concurrent with the public relations and marketing activity the delivery system grew from 8 to 
19 MHMOP contract IPA provider gfoups. In addition, the MHMOP executive staff prepared and 
suDmittea an niviu aeveioprn«nL grant ^nuposai tu i^LLiityy. 

Approximately eleven months after MHMOP came into existence (October, 1974)' DHEW accepted 
and funded this development grant proposal for, $266,000.00. With this assistance, MHMOP became 
the only DHEW-funded (Multiple Individual Practice Association Model HMO) development grantee 
in the St^te of Michigan. 
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JHE MHMOPSEUVERY^YSTEM 



As a Multiple IPA group practice model HMO, MHMOP provides health services by contracting 
the physician co^rations (Multiple IPA*3) to delivery (Title XIX covered) health services td eligible 
individuals. These ph3?sician owned JPA's^ are pre-paid on a capitation basis Witb funds received by 
MHMOP from the Michigan State Department^of Social Services. In exqjiar^e for this capitation 
payment the IPA's assume total Responsibility for the* delijvery of primary health care servicei^ to, 
individuals assigned to their IPA by the MHMOP marketing staff. * 

MHMOFs definition of primary health care services are |)ediatric/ OB^YN, surgery, 'general 
practice or internal medicine physician services. 

Other health services, such as hospitalizationi^ emergency care prescription drugs, transportatidn 
and physician prescribed supportive health services are provided and paid for by a second provider 
component of the MHMOP delivery system. Out-of-area Inedically necessary emergencies are also 
covered through this delivery component. . .. . , 

This second component of the MHMOP delivery system may l)e described as the adminis^trafeive 
and coordinative resource of the IPA multiple group practice network. ^ 

At the present time (November, 1975) there are contract IPA*s ip the delivery 

system. These IPA's are located in the inner city of Detroit and suburbs^^urrounding the Detroit 
metropolitan area. « This network of IPA*s facilitates optimum convenience and accessibility for 
MHMOP enrollees. 

There are numerous advari/ages to this provider network. For example, eligible enrollees who 
voluntarily choose the option to receive health care services ^om MHMOP may elect to receive these 
services at one of the MHMOP contract IPA*s located near their home. A second advantage is the fact 
that many of the MHMOP contract IPA*8 were already operational at their present location and had 
also previously been the providers of primary medical services for the areas' residents. As a result 
residents fn the area, that became MHMOP enrollees, experienced minimal (if any) interruption in 
the continuity of health services provided by the IPA. In fact, the creation of MHMOP has optimized . 
• continuity of care by providing a mechanism for comprehensive health, care. In th€ near future tk^ 
MHMOP option will be available to non-Medicaid individuals and employer groups\ Through the use 
of existing health delivery structures and health manpower resources, MHMOP ha^ been successful 
in developing a delivery system which required minimal expenses fok facilities and capital 



improvement. 

; "hie MHMOP EnroUee 

Wh6n Medicaid eligible recipients voluntarily elect to receive al/of their health, services from 
MHMOP, and their Medicaid eligibility is subsequently verified by tl;ie Michigan State Department of 
Social SerV^es (MDSS), they become MHMOP ' enrollees . After enrollment by MHMOP account 
^ executives, they are given a membership kit. This kit contains the location and name of all MHMOP 
contract IPA's, the physician staff at thes^e IPA's, all ^HMOP participating hpspitals and other 
specific infoni^don on how to utilize all of ihp available services of MHMOP. The new enrollee alV» 
exclian'ges the Medipiid card for a MtlMC^^embership card. This membership card can be used at 
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MHMOP contract IPA's and MHMOP participating hospitals. Since at the present time MHMOP does 
not offer dental services, the enrollee subsequently receives a "Dental Only'' Medicaid card from the 
Michigan Department of Social Services, However, MHMOP does maintain a list of dental physicians 
who have indicated a desire to provide services to Medicaid eligible recipfients. This list is made 
available to MHMOP enrollees upon request. 



Developmental Problems 

MHMOFs biggest problem is its accelerated growth rate. In February of ^1973 MHMOP had a 
Detroit based administrative staff of 2 in an office area of 911 square feet. At the present time there 
are over 100 employees at a new office location in the downtown Detroit area. The square footage 
used by the MHMOP staff (on t»ie 22nd floor of the Walker Cisler Building) is 23,000. 

Present expansion plans include an additional 4,500 square feet (on another floor) at the present 
location, and enrollee service offices in Oakland and Macomb Counties. 

MHMOFs (Detroit office) on-premises 90/60 UNfVAcf^ computer is the nerve center of its 
Management Information Systerr^E^ceptional administrative leadership and management skills has 
enabled MHMOP to successfully survive the multitude of problems that are common to organizations 
that grow at an accelerated rate. For example, MHMOFs membership revenue in 1974' was 
$4,076,248. Its membership revenue for 1975 will exceed 12,000,000. ' . . 



DEVELOPMENTAL OBSTACLES / 

MHMOP, unlike oth^T^etroit area groups interested in HMO development, has managed to 
survive the HMO planning and, hopefully, the developmental stages. It has survived because of its 
organizational structure and its access to the management skills needed to plan and develop an 
HMO. "Hence, two of the most difficult bar^-iers have been overcome. Li^ other HMO's, MHMOFs 
opportunity for a fair or competitive market test (when it enters the non-government funded private 
market) is constrained by the special requirements of Public Law 93-222 that, do not apply to other 
providers of health services. For example, open enrollment (little opportunity to exclude high-risk 
groups) and comprehensiveness- and scope of coverage (a mandatory full coverage benefit package). 

JTie unfamiliarity of cohsuraers with health* maintenance organizations and a reluctance by most 
consumers to^change their health, utilization patterns to a preventive maintenance posture presents 
Vet another ojbstacle for MHMOP, ' \ ^ ' 

Other obstacles to the development of MHMOP and other HMO's is the failure by health policy 
makers at DHEW to issue final guidelines on some key issuep in the HMO legislation (see p. 5). In 
addition, HMO's are subject to state -HMO legislation (where it exists) its promulgated rules, and 

' regulatory authority. 

Many proponents oiF HMO's believe that Federal, state artd local regulation of HMO's is the single 
most significant impediment to their development. . ' 
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UTILIZATION OF HEALTH SERVICES BY MHMOP ENROLLEES 

At the present time, October, 1975, all MHMOP enrollees are Medicaid eligible. However, their 
health services utilization h^is not been dissimilar from that of other HMO enrollees in the United 
States. Current MHMOP hospital utilization data indicates that^MHMOP enrollees pr^ected hospital 
utilization for 1975 will be 608 hospital days per 1000. this utilization rate is approximately one-half 
the rate experienced by Blue Cress plans in the United States.*^ It is also comparable to the National 
Hospital utilisation data of 550 hospital days per 1000^ for other operational HMOS. 

MHMOP Hospital length of stay data also indicates that the projected length of stay for 1975 is 
^ 5.5 day^ Utilization of those health services (other than'^MHMOP IPA contract pre-paid capitation 
services) is onXy^^c of MHMOFs total cost. . ^ * 

The above data would indicate that the HMO concept, of placing emphasis on preventive and"^ 
ambulatory care, does impact some health services utilization rates and hence dramatically reduces 
the overall cost of care. On the other hand utilization of health services by an HMO enrolled 
population only measures utilization and should not be confused with the effectiveness or 
^ ineffectiveness of a delivery system. Other variables such as Hi^ed, accessibility, av£^i lability, income, 
education and pre-established health services use patterns, also dramatically impact service 
utilization^ However, the MHMOP delivery system is designed to minimize the negative impact of 
these variables. * ' ^ . 

Exhibit I depicts MHMOP enroUee revenue administrative and health services cost allocation. 

1. Administration 

Administration" represents the administrative cost incurred to opepate the MHMOP 
delivery system. a - 

2. Health Services Cost Allocation 

^^Ambulator^^ Primary Care Services" represents primary care capitated services. 
"Speciality Referral" represents those services not provided as capitated service. 
^^Hospital Emergency Room Services" represents emergency services provided by hospital 
emergency rooms. . 
^^Hospital^npatient" represents inpaU^p^ hospital cost. ^ 

The MHMOP delivery system is representative of one HMO mechanism that is increasingly 
being viewed by health professions as a means for lowering health care* cost. Because the HMO is a 
"closed organized system" it theoretically can be operated more efficiently than a traditional "fee for 
, service" open system. To date, the MHMOP experience suggests that this theory is valid. 




*Bloom, S.S., and Denny, R.P., "The Medical Corporation, Houston, Teuas" Industrial Engineering, May, 1974. 

/ 

o , ■ .. • la 181 

ERIC , ■ 



HEALTH CARE SERVICES AND RESOURCES AVAILABLE TO 

MHMOP ENROLLEES 
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PREVENTIVE SERVICES 

• Care and services provided by a MHMOP physician, including office visits, 
hospital care, etc. 

• Physical examinations and diagnosis 

• Immunizations ^ 

• Laboratory and 3C-ray services 8ls required 

• Out-patient care and treatment of ^illergies,' illnesses and accidental injuries 

• Well-baby care for all children up to 2 

• Annual hearing and eye examinations for members age 40 and over. 

• Bi-annual hearing and eye examinations for Members- ages 2 to 40 

SPECIAL SERVICES ' ' 

• All drugs and medicines as prescribed by a MHMOP physician 

• Con;fictive ereglass lenses and-or frames, (not including ccmtact ^lensesj) as 
-presceibed by the doctor as often as yearly 

• Consultation and special health services including speech therapy, physical 
therapy, foot therapy and eye therapy, and all necessary equipment as requested 
by a MHMOP physician. 

• Diagnosis and counseling for psychiatric disorders (not over one visit per week for 
a maximum of one year) 

• Psychiatric in-patient treatment as is considered necessary by a MHMOP 
physician (limited to 45 days per stay in a special psychiatric care-unit) ^ 

• Home care nursing services (other than privaft;e duty nursing services) by a 
registere d^ urse or licensed practical nurse when requirap 

• home care niedical supplies, equipihent aricT'artificial limbs as required while 
at home ' - . » 

• Health education 

• Ambulance service to and from the hospital as ordered by MHMOP plan 
physician ' \^ 

Counseling for family planning * 

Nutrition counseling 

Counseling for personal and environmental health problems 



HOSPITAL SERVICES 

M 

• In-patient services in semi-private room accommodations (private room when 
considered medically necessary by a physician or surgeon) 

® In-patient long-time care in hospital, nursing home, etc. 

• All ^)rofessional care services of attending, participating and consulting physicians 
and other health specialists \ 

• All medical supplies, equipment and artifical limbs necessary for health care and 
treatment in the hospital . * 

• In-patient radiation therapy, speech therapy and related seji;vices 

*■ . . .... 

® Emergency and follow-up treatment of accidental illnessess and injuries as is 

necessary for /health care and treatment by a MHMOP physician 




OUT^OP-AREA EMERGENCY SERVICES 

• Ajl necesskry services for treatment of emexgency illnesses. or accidental injuries 
' encountered while out of the MHMOP service area 

(An Enrjollee receives all hospital and professional care services while out of the 
MHMOI^ service area, provided that such care and services are equal to the 
normajPcost for them within the MHMOP service area.) 

MATERNITY CARE SERVICES ' ' 

• Complete before birth and maternity care for all female members 

• All physician, surgeon, hospital and related care services for mother and child 
while in the hospital 

• <i{ymplete after-delivery care for mothfer and newborn 



\ 
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HEALTH CARE RESOURCES AVAILABLE TO 
MHMOP ENROLLEES 

• Orthopedic Shoes 

• Hearing Aid * « 

• Prosthetic Devices & Braces 

• Eye Prosthesis 

• Home Health Supplies (beds, wheel chairs) 

• Speech & Language Evaluation. 

• Speech ,& Langiiage Therapy 

• Guidance in Hearing Aid Selection ' 

• Aural Rehabilitation 

• Manual Communication 

« In Home Supportive Services (Domestic Assistance) 

• Respiratbry Home Services 

• Pregnant Addicted Women 

• Home Nursing 

• Home Occupational Therapy 

• Ambulance 

• Cab 

• Other Sur^ce Transportation 
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MARKETING CONSIDERATIONS 



Marketing a p^^e-pai^ gmip paeticr^an presente same uni<|tie. problems. Traditional marketing 
techniques often parpetuafe the slogan that "the consumer is always rights In the provision of health 
se/vices, the consumer \q often unafete^ accura&ly-evahaate the quality or, value of what he or she 
buys; As a r^&sult, th© con8um©r*s judgnt^'^t fe^-<^en based ofi-personal satisfaction. Just as pfl^n, 
however, per^ngil satisfaction may not mean tSirt the laonsumer Kfe v^r^ceiyed adequate health 
, services. At the fiame tinie^tte physician justifiably (Stid often 4?^idly) believea that he is always^, 

right. As a result, when there ate ar^aa of disagreement which involve cbBOumers and the physician, 

* -~ " '.' ** 

the Flan (MHMOP) is always perceived as wrong,. * 

,< ^ ■ * 

, Through the ibmbined efforts of the Marketing Department and the Health Education Division, 
meetings ^e held with MHMOP enrollees on a weekly basis. These meetings are designed to heJp 
enrollees better understand the everyday problems of a pre-paid group practice delivery system. To 
^dat!^ enrollees have exhibited positive and negative responses to the MHMOP delivery system. 
However>fe^cause consumers are unfamiliar with the HMO health services delivery concept, many 
whio enroll volunl^tpU^ disenroll without utilizing the services. 

Changing the inapph>pjnate health services util^tion patterns of consumers who are not 
familiar with an HMO delivery System pi^esents yet anptfter problem for the MHMOP Marketing 

Department. As a result, MHMOFs enroHtQent growth riiay be attributed to the accessibility of 

j 

health services for enrollees and the Continuing enrollee health education programs. ^ 

MHMOP has gained invaluable health services marketing experience in an extremely difficult 
market place. In the future, the experience gained by MHMOP in the Medicaid market will serve as 
an invaluable asset when the MHMOP delivery system is available to all residents in the Detroit and 
tri-county area. ^ v 



Marketing Department Responsibility, 

The Marketing Department designs and implements marketing strategy decisions. A second and 
'co-equal responsibility of the Marketing Department is to identify poterftial enrollees for MHMOP 
avj^ to coordinate the activities of Marketing with Public Relations. 



Organization of the Marketing Departnient 

A Director of Marketing, a Marketing Managc/r and a Market Research Analyst serve as 
administrative staff for this department. Account E?cecutives (MHMOFs saleg staff) report directly to 
the administrative staff of the Marketing Depart^ffent.* 

The primary responsibility of the Director, of Marketing is to direct and coordinate all Marketmg 
Department and Public Relations activities. 188 
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Marketing Department Activities ^ ' 

The Marketing Manager^s primary responsibility is to supervise the Account Executives. 

The Marketing Resetirch Analyst provides the Marketing Department with ci:^ent health care 
and public relations data needed to plan and coordinate marketing and publip relations activities. 

Account Executives are responsible for the day-to-day marketing of MHMOFs HMO program to 
th^ public. \ 

The marketing activity does not stop after {Potential enrollees commit thcfraselves to joining 
^MHMOP. The Account Executives m^ke themselves available (via telephone and/or personal visits) to 
xontinuaHy advise enroftles of the^ervices available to them as MHMOP enrollees. As a secondary 
responsibility, the Account Executives act as liaison persons or service representatives for MHMOP 
en^Uees. This mechanism provides a vehicle for enrollee acce^ to MHMOP via a personal 
representative. 

Account Executives may also be concurrently involved in the foUowi^;!^ activities. ^ 

1. Identifying potential provider groups. 

2. Assessing the^ reaction of enrollees to services provided for tnem B^. MHMOP contract 
providers. 

2. Making presentations to other interested community groups and/or organizati^ 

3. Monitoring the activities and marketing methods of competitors. 

4. In-service training classes, on MHMOP marketing methods and techniques. 

The Medicaid Market 

■ ( 

^ Individuals eligible for Medicaid assistance fall into four general categories: 
1. Old Age Assistance iOAA) 
Aid to the Blind (AB) 
't3.f Xid to the Disabled (AD) 

^ 4./ Aid ta Families with Dependent Children ( AFDC) 
qecause of the disproportionate amount of the Title XIX, eligible recipients^ in category 4., over 
95^f of MHMOFs enrolled population consists of AFDC eligible persons. 

; 
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"^x THE PRIVATE MARKET 

«. ^ • 

' (NON-GOVERNMENT SPONSORED HEALTH PROGRAMS) 

The term ^^Priyale Market'* is' used by MHMOP in reference to those individuela, 
employer-sponsored health plans, employee groups^ union-spoiieored health plans and others that 
wish to purchase health services from MHMOP. • .^r*<^ 

Hov/ever, before MHMOP can offer its plan to the private market it must ax^eij^y^ppmysA of its 
application for an ejipansion of its limited certificate of authority under Acts 108 andTd9. (Act 108 
for medical corporations, and Act 109 for hospital corporations). Approval under these acts will 
represent an interim step to the private niarket licensure process. When this licensing process is 
completed, MHMOP vyill join Michigan Blue Cross and Michigan Blue Shield as a fully licensed ^ 
medical and hospital corporation, for whom these acts were originally created. 

Simultaneous^/, MHMOP is also proceeding with these steps necessary to obtain a full license 
under Act 264 (the State of Michigan HMO Act)., Act 264 is the act that specifically applies to HMO's 
that wish to bperate in the State of Michigan. 

(MHMOP looks forward to competing with the Blues) 
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THE PUBLIC RELATIONS DIVISION 

»As— p^viwQly --mentioirsed, Marketing" and* Public Relations airo eJcsely misted activi^ties at 

MHMOp. The Public Relations Division's uctivities encompass five basic and general areas: * 

1. Media Relations 

o 

2. Community Relations 

3. Public Information and Education 

4. Public Affairs ' , 

5. Internal Communication j 

Because of MHMOFs scope of operations it is essential to maintain an up-to-date, two-way 
communication flow between MHMOP and the various media in the area. The information received 
from the Public Relations Divi^n must be .concise, accurate, and informative due to relative 
unfamiliarity of the general public to the HMO concept. 

When providing a needed health service for a community the image of the provider must be 
positive and believable. If MHMOP fails to CKpress a true concern for the welfare of it's enrollees, the 
rela.tionship between the Organization^and the enroUee will be threatened. Through o series of formal 
and informal, public affairs progralns designed to be both informative and educational, the precefeding 
can be demonstrated. A trusting, one-to-one relationship must be cultivated, and it is the 
organization's role to provide Ithe initiativ<?. N,,^ ^ 

In order for any organization to (junction properly, the internal conununication network must be 
an efficient one. The . Public Relations Division serves as the liaison between MHMOP's 
administrative and medical staffs. Other health professionals who may seek information or assistance' 
from MHMOP in health rdated areas jir,e fTnsj; referred to the Public Relations Division. 

It is clear that because the HMO concept, particularly the MHMOP model, is an unfamiliar 
coricept, it is extremely important forthe Marketing Department and its Public Relations Division to 
function as, a team. By coordinating their activities and publications, conflicts relative to program 
information can be eliminated. 
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HEALTH CARE ADS^INISTRATION DEPARTMENT 
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HEALTH CARE ADMINISTRATION DEPARTMENT NARRATIVE DESCRIPTION 

/ 

The Health Care Administration Department (HCAD) is re^onsible for the coordination of 
Claims Processing (non-capitated fee-for-service health service^)^ and Health Care Administration 
t*, activities of t^^e Michigan Health Maintenance Organization^ Plans, Jnc, (MHMOP). The Claims 
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Processing Division includes the review and audit of invoices for all velidors (e.g., fee-for-service 
referral physicians, hospital, ancillary services, etc.). /he Health Care Administration Division 
includes: subscriber services; emergency medical triag0 service; health education; transportation and 
disenroUment service activities. The^ICAD is als<3 responsible for informing MHMOFs contract 
Individdal Practice Associations (IPA's) of their reporting responsibilities to the Plan's Central 
Office. o ' 
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THE CLAIMS PROCESSING DIVISION 

^ ^The^ Claims Processing Division is responsible for the review and audit (preparation for payment) 
of all invoices (bills) received from health services^ J/endors that ha\?fe provided non-capitated health 
services to MHMOP enrollees. These are services that cannot be provided by the MHMOP contract 
IPA to which- an enrollee has been assigned. For example; these invoices are received by MHMOP 
from hospitals for inpatient and emergency room services or other specialty services that may be 
required by enrollees. 

The Claims Processing Department is also responsible for maintaining a record of all 
(fee-for-service) health care services provided for enrollees. 

An average day's activity \rr^l!h€^la'\ms Processing Division would include the review and 
approval or disapproval for payment of: > 

(a) The scope of the services provided ^ 
y ih) Provider charges . ' 

(c) Comparison of Provider charges ^ 

(d) The appropriateness of the^e ^charges 

When and if fee-for-service invoices show charges that are not .consistent with the usual and 
customary charges received hy MHMOP, they are forwarded to the Corporate Medical Director for 
hnedical review arid disposition. 
. ^ More specifically the Claims Processing Division does the following: 

1. Eligibility Pre-Certification - 

2. Invoice Audit , ' ^ ' 

3. Invoice (medical) Review 



ELIGIBILITY PRE-CERTIFICATION 

MHMOP's contract IPA physicians must notify, MHMOPs pre-certification clerk before admitting 
a MHMOP enrollee as an elective in-patient. It is the responsibility of the pre-certification clerk to 
issue authorization for treatment after verifying an ?nrollees' eligibility. Pertinent information 
relative to hospitalization is recorded on an "Eligibility Pre-certification form." o 

This form is used to monitor hospital utilization and project hospital cost. The post certification 

function begins when an in-patient hospital invoice is received at MHMOP's office. Invoices are 

i 

checked for: 

(a) Eligibility at the time of hospitalization. 

(b) Whether or not admission was pre-certified.* %J ^ K^'^. 

(c) Length of stay comparison by IPA. 

*fn the event that in-patient invoiceH are identified that wew not pre-certified, a notification of failure to pre-certify is sent to hoth the hospital 
and the MHMOP contract IPA attending physician Final decisions on non-pre-certified hospitalized patients are made by the (physicianl 
t EK^cutive Vice President of HCAD andor the Corporate Medical Director of MHMOP. 
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INVOICE AUDIT ^ ^ ^ , 

The Claims Processing Division Supervisor has responsibility final review ofWll invoices 
(claims) to verify that the amount billed, to MHMOP, fof- a service is consistent with the^easonable 
and customary amount billed for the stated diagnosis. The criteria used reflects the standards* 
establishecf for inpatient services as well as quality assurance and utilization review standards 
developed in conjunction with the Corporate Medical Director. Questionable claims requiring 
sophisticated medical judgment are referred to the Corporate Medical Director. When the final 
approved payment for the claim is determined, this is noted on the claim form. Copies of the approved 
form are distributed to the Accounting Department, Data Services Department, the provider file, and 
the service provider. The service provider, if it is a physician, also receives xerox copies of any 
accompanym^ medical records. The original copy of the claim form and the medical records are ' 
retiirned to the patienf s medical file. , 




INVOICE (MEDICAL) REVIEW 



It is the responsibility of the Claims Processing Division's supervisor (a registered nuree) to 
review all invoices and assess tfte appropriateness of the services relative to the diagnosis and health 
cam^ services deceived by enrollees. Also, invoices identified ^vhich appear to be inconsistent with 
length of stay distribution comparisons, by diagnosis, are r^f^red to the Corporate Medical Director 
for final review. Length of stay compariaona between MHMOP contract IPA's are ako calculated 
wli^n the invoice audit is in proeess. 

Invoices received from MHMOP providers are sorted by type of service. These invoices are not 
processed for payment until all appropriate medical data related to the in voic«#si^ received. When the 
above medical data is not received with the invoice^ a letter requesting the additional needed medical 
data is sent to the provider. This activity facilitates and contributes to a health services demand data 
baseband provides appropriate data for the purpose of utilization r(^viev/ ' 

This data is available for review and analysis by the Corporate Medical Director and the 
(physician) Executive Vice President of Health Care Administration for RJPMOP corporate physicfan 
peer review. ^ • 
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HEALTH CARE ADMINISTRATION DIVISION 

At the Michigan Health Maintenance Organization Plans, Inc. (MHMOP), direct health services 

are provided by MHMOP contract IPAs. Health Care Administration facilitates fehe delivery of 

services in the following, areas: 

" ^ . t 

a. % Health Education * ^ . 

, b. Subscriber Services . ' 9 

c. Provider Relations - . 



j . HEALTH EDUCATION 

Health Education has the responsibility of meeting the objective of adequate health education 
program planning as set forth in Pyblic Lam ^3-222 which requires HMOs to actively provide for its 
members: health education services; education in the appropriate use of^health services; and making 
members aware of the contribution that they can make to the maintenance of their own health. Iii 
order to meet this objective, Health Education is charged with the following responefibilities: 

1. Increasing the ability of MHMOP enrollees to make informed decision affecting their personal 
and community well-being. ^ . 

2. Educating MHMOP enrollees and provider groups about the HMO conCepO ^ 

3. Informing MHMOP enrollees about the available services to them via MHMOP and 
appropriate utilization of the services. 

4. Facilitating the transition from the traditional fragmented system of health care delivery to 
an integrated system of health care dfeliveoMn^an H^O setting. 

5. Development and implementation of MHMOPsTDtgt Control Class. ' ~ , • 
Hea^lth Education cannot work in a v^cuufn if it is to attain the above goaj^ Therefore, ther 

. Health Educatiop. Unit must work closely with tjie Information Systems Deptfrtment to establish and • 
define the data baaec^necessary to make sound health lec^ucation planning/ decisions. The liealth 
Education Unit must work cooperatively, as well, with the Marketing Departm^t. For exLmple, the 
Health Education staff keeps the Marketing Staff advised^ of the areas newe^l^^ltees ^i^Q^ 
understand at the time of their enrollment. Marketing responds by identifying for the Health 
Eflucation staff, enrollees or groups of enrollees that may need special attention. 
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MICHIGAN HEALTH MAINTENANCE ORGANIZATION PLANS, INC. 
(MHMOP) DIET CONTROL CLASS 

^Narrative Description 

Thfere are four objectives of the MHMOP Diet Control Class: " _ < 

1. To increase the utilization of Health Services by- MHMOP enrollees. 

a. All class members are required to have a physical examination before joining the 
class. 

b. All class members are encouraged to have at least one visit per month' with their 
physician, to keep the physician irfformed of their progress and general health. \ 

2. To increase the enrollees' ability to maintain a balanced diet while reducing the amount of 
food consumed. 

a. t All class members are given a Diet Control Handbook (developed by the Supervisor 

of Enrollee Education) which ej^lains what to eat, how much, and when. This book 
is reviewed each week during class session. 

b. Weekly menus ate given to' class participants with suggestions for well-balaneed, 
ndn-fattening meals. ^ . . 

3. To attempt to impact the health hazards relMed to obesity, hypertension/ diabetes, and ulcers. 
- via diet control. " 

a. Class members' weight loss are charted weekly. 

b. Progress reports are given to their physicians and the class members each month. 

4. To increase the enrollees' ability to p|an nntritious meals at a lower cost through proper food 
buying and budgeting 

a. Class members are given food buying information each month. 

b. Members are encouraged to read local newspapers for information on food specials. 

c. Class members are informed of price selection methods. 

Most available data indicates that the routine approach, for the treatment of obesity, does not 
work. This approach involves a short office visit during which the member is (1) handed a booklet of 
basic dietary, instructions; (2) given a prescription for appetite depressants; (3) threatened, lectured, 
or counselled on self-control. / 

One reason this approach failf^s because the individual is required to follow prescriptions 

amounting to drastic changes in lifestyle. It is unrealistic to expect a person to forsake long 

4 

established, highly gratifying, habitual iz6d responses without teaching them alternative reinforcing 

\ 

responses that are compatible with long-established habits. Hence, MHJVIOPs first step for diet 
control instruction is to provide relevant and realistic information on tlie subject t6"^^s participants. 
Weekly class sessions, between 30 and 9Gt minutes, are conducted over a period of several months to 
accomplish this step. 
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SUBSCRIBER SERVICES 

Subscriber Services, plays an ombudsmen's role in MHMOP. It serves as a liaison between the 
enrollee and the provider. In addition, Subscriber Services is responsible for: 

(1) Emergency Triage Systi^m (Hot Line). 

(2) Enrollee Grievance System. ^* • 

(3) Enrollee Orientation Program. 

(4) Patient Transportation. 

As part of the routine proc^sing of the emergency triage system and follow-up process and 
enrollee grievances, ^Subscriber Services also responds to routine general information inquiries, 
billing and refund inquiries, and requests for primary care unit transfers by enrollees. Descriptions of 

the above mentioned activities of Subscriber Services are listed below. 

tk ^ 

111 TRIAGE SYSTEM (HOT LINE) . 

Michigan Health Maintenance Organization Plans, Inc. (MHMOP) has developed a unique 
Medical Trrage ^^tem. The triage system, commonly referred to as the emergecyiHot Line is a 24 
hour» seven days a week telephone service. The emergency Hot Line is available to all MHMOP Inc. 
enrollees who need assistance if an emergency or crisis ari^^es. MHMOP employs Registered 
Emergency Medical Technicians (REMT's) to answer Hot Line telephones. Most REMTs have 
curiipleLed three yearts wf coiiege ajicj have had ai least two years of direct patieni contact experience 
in an emergency room andor ambulance. In order to reach the level of a Registered Emergency 
Medical Technician, one must first complete a recognized course. The minimum class time^is 81 hours 
of practical emergency room and/or ambulance clinical practice. The course- involves an accelerated 
curriculum on the handling of the sick and injured. The curriculum also involves extensive study of 
anatomy and physiology. . u P ^ ^ 
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WHAT HAPPENS WHEN SOMEONE CALLS 
MHMOP EM|RGENCY 



PATIENT Cj^LLS 



Delemninalion as 
e^ctent of illness or 
accident — advice on 
immediate^ first aid 



lol 
:q on 



Doctor co6itacted 



Emergency 



o r 



Referred to 
4=«^mergency Service i 



T 



Transportation 
arranged if 
necessary 



Treated at the' 
emergency ^ite^ 



Treated and Released 



Hospitalized 



Released and 
referred to 
center for 
follow up 



or 



Treatment at 
penter during 
regular office 
hours 



Referred to 
Specialist for 
treatme 
necessery 




Admitted to 
hospital where 
MHMOP physician 
treats 



Discharged and 
referred to center 
for, follow up 
care 



, Referred to specialist 
for^reatment if 
necessary 





Non-MHMOP 
Member 




i 




Referred'to 




appropriate 




community 




agency 



NON-Emergency 



Referred to center 
fpr treatm(9nt during 
regular office hours 



deferred to 
Specialist for, 4^ 
treatment if 
necessary 



Specialist cabled 
irjfoctr^fnent 
if necessary 



/ 




DETERMINATION OF ENROLLEES NEED FOR EMERGENCY MEDICA*^ SERVICES 

With the exception of an immediate life threatening situation, physician guidance is always 
sought. The patients primary physician is contacted and advised of the patient's complaint. The 
physician will either call the patient directly or relay his recommendej treatment tj^rough the 
Registered Emergency Medical Technician to the patient. If it is necessary to hospitalize a patient, 
the REMT will contact the hospital in advance, advising them of the impending hospitalization. 

Further, throughout the night the REMT will check on the progress of the patient at home or in 
the hospital. Copies of all authorization of hospitalization are referred to the Pre-Certification Unit of 
MHMOP. (See MHMOP Emergency Flow Chart, p. 26). ^ 



ENEOLLEE EDUCATION REGARDING USE OF EMERGENCY SERVICES " 

Enrollees are advised at the time of enrollment of the twenty-/our hour hotline services provided 
by MHMOP. Th(?y are alsD mailed an adhesive sticker that can be attached to their telephone which 
indicates emergency hotline services twenty-four hours a day, seven days a week, call 961-3636. 
Appropriate u.se of the Hotline is reinforced during the enrollee orientation program. 



. . EMERGENCY FOLLOW-UP 

V 

The Emergency Triage System Staff will closely follow an HMO enrollee s progress though an 
emergency room and check t-heir condition at home, if the situation dictates. The Subscriber Services 
Unit Staff will then later contact the enrollee to assist in arranging for an appointment at IPA -to 
which the .patient is assigned. Subscriber Services is also equipped to assist in getting prescriptions 
filled, provide transportation to and from'^physician's office when necessary, as well as reinforce 
directions already presented to the patient. For example; Subscriber Services will readvise the patient 
' to follcTW a strict diet, or to .see the physician regularly for control of a medical condition. 

/ 
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ENROLLEE GRIEVANCE 

An enroUee may Resent a grievance in one of three ways: via telephone, in person, or written. 
<See MHMOP Member Assurance Program Organizational Flow Chart, p, 28). At every .stBp of the 
grievance process, the enrollee will be advised by a.Jetter and/or a phone call of the current slcatus of 
the complaint. If the enrollee choses to -complain via t]ie telephone^ the Subscrrber Services StafT 
Social Case Work Aide or the^REMT wilj listen to the complaint and prepare a re|x)rt of the 
grievance. V^here possible, they will resolve the problem at their level and document the resolution. If 
this is impossible, they'will refer the problem to the Supervisor of Phone Services for consultation 
and/or resolution. The Supervisor of Phone Services will make a 'determination on the appropriate 
direction in the handling of the resolution which may entail referral of the complaint to the Field 
Service Section. The Supervisor of Phone Services, will refer all completed work and/or problems, not 
resolvable at the Phone Service 'Section or the Field Service Section, to the Manager of Health Care 
Administration. 

The Manager of Health Care Administration will review the action taken by the Phone Service 
and Field Service Sections of Subscriber Services, making recommendations for resolution which may 
include referrBl to the Director of HCAD and/or the Executive *Vice President of Health Care 
Administration for their information and/or recommendations and resolutions. 

The director of HCAD wMl evaluate the complaint and made recommendations for resolution 
andor forward the complaint to the Executive Staff for their review. Likewise, the Executive Vic^ 

President of Health Care Administration will review the complaint regarding medical services. He 
may discuf^s the problem with the President of the patient's medical center and refer the resolution 
back to thi^ Manager of Health Care Administration or he may determine to refer the question to the 
Executive Sj^aff for a policy decision. ' - ^ 

The Plan's President, Senior Executive Vice President, Executive Vice President "of Health Care" 
Administration, Director of HCAD, Director of Marketing, Director of Finance and Director of 
Systems comprise the Executive Sta^ff Committee. The, Executive Staff Committee will review the 
complaint and take the appropriate act^ion. 

If the complaint entails modification of policy, a report will be filed with the Senfor Executive 
Vice President for presentation to the Board of Directors. 

The Senior Executive Vice President will prepare a report for the Board after examining the 
policy questions. The Board will advise the Senior Executive Vice President of their decision; aHd he 
will disaeminate the information to the appropriate parties so* that the MHMOP member can be 
advised of the decision. ^ # 

The member retains the right to circumvent the MHMOP appeal process and appeal directly to 
the Michigan HMO Commission (under the auspices of Public Act 264) 4t any time. 

^ Resolution of the patient's problem may take the fopm of modifying the existing system, 
arranging for services, the interpretation of the MHMOP system to the client, or a disenrqllment of 

, . - 29 



the enrollee from the program, The Member Assurance Program is viewed as a problem solving 
process rather than a dieenrollment process. It^any event, documentation of the patient's complaint 
and resolution of that complaint will be included irTtfrfe patient's record. 
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ENROLLEE ORIENTATION 



The enrollee orientation project was developed in compliance With the>^MO promulgated rules. 
The primary goal of this project is to incorporate the enroUees into the^flMO delivery systeni and 
to keep them informed on how to%olve problems that they may encounter when using the system. 

. V ■ - • 

Health Education Activities . ^ ' 

There are four basic sub-objecjivfes to this project: ^ 
^^^\. To inform enrollees on how to utilize the health servicei§ provided by ]\^MOP. 

2. To insure appropriate emergency room utilization. 

3. 'fo inform enrollees on how to solve service prpblems when ^^y^rise. 

* 4. To reduce disenrollcnent which results from consumer ignorance of appropriate and equitable 
utilization of Services. t ' 

Narrative Description of the Enrolled Orientation Sessions 

- \ _ 

Subject areas discussed anjj. resources uaed occur in three ar^s: (a) Enrollee EducatioTi, (b) 
Subscriber Services and (c>^Public Relations. The fol^owirig is a brief description of tbe above. 

JWj , \ ♦ ' 

(a) Enrollee Education ^ - o 

Addresses the MHMOP preventive and health maintenance care concept and how to utiliz§ the 
^ervices provided by MHMOP. Information is provided in the following areas: 

a. A brief history of MHMOP. 

b. T|ie elements of an HMO via slide film presentation. » - . 

c. Review of educational brochures. * ^ 

d. FnfoilTiing enrollees of other health and health related programs thart they may he eligible for 
as MHM9P enrollees. 



e. Explanations of all. MHMOP support staff functions. 



f. How health data is collected and how it is used. 



V g. Conducts an informal pre and post test Purvey. 

(b) Subscriber Ser%rfces * ^ ^ , ^ 

Triag'e R^onnel in the Subscriber Services area: " * ^ 
a.^/^c/ibe MHMOFs Hot Line.. 

Ej^lain emergency service procedures. ^ , 

Explain^ow to arrange transportation, and resolve problems related to transportation. 

Ex^laip th^function of transportation (e.g., prescription pick-up, medical appointments, and 

^Mergency transportation service.) ,fi^iiK * 

Explai^4-he importance of^ teaching children how to a^^^e Hot Line j|umber. 

\ J ' - ^ " 
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PATIENT TRANSPORTATION 1 

(a) Ambulance iJtilization ^ \ " ^ 

Ambulances^ are utilized in providing transportation from an enrollee^s current location to arv^ 
emergency room. Such transportation is^ utilized in "life threatening** emergencies as well as other 
situations which although not immediately "life threatening" do require the special equipment fiuld/or 
trained personnel normally found on an ambulance. ' / 

A life threatening emergency is one in which a member faces serious, imminent consequences of 
a medical emergency. These consequences include, but are not limited to losi of life, paralysis, brain 
damage, loss of limb. Examples of life threatening emergencies which would be transported^by^^ 
ambulance are the following: . , , ^ 

— Respiratory Arrest> 
— ' Cardiac Arrest.^ 

— Severe Bleediing, e.g., injui^^g'Sula^ined to an artery. 

— Shock, e.g., anaphylatic, electric, epigastric, h5^oglycemic, insulin, mental, surgical, 
traumatic. • 

— Suspected Heart Attack. , ' 

— Respiratory Distre^! 

Limb Severed. * ^ , 

— Unconscious. / 

— Major Penetrating Wound. * y 

Other areas where ambulance transportation is necessary for an enrollee to repsive services are 
the following: % ^ : 

— Suspected Broken Leg. 

^ — Suspected Broken Hip. - 
. — Open Type Fracture (any bone). 
, — Othier Sus{ject^^'?CBnormality which cannot be practically transported by means 

* ^ ' other than an ambuj^ahcei' (e.g. a 500 lb. patient who cannot readily fit into the door 

of a station wagon). 

— '^oman in Labor. ^ . 

(b) Utiiization of O^er Transportation . . . Non Ambulance Form 

Other lan4 transportation is also safely utilized for ,the following patient conditions: 

— High Temperature. • ' - 

— Abdomins^l'Pain. . ' v » 

— Shortness of breath, e.g. shortness of breath being experienced by a known 
^ asthmatic. ^ 

— Non-set^eiF^ bjteeding. - 

— Return trip frdm hospital to home. 

' . /' ■ . , 2.)6 • 
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— Transfer from hospital to hospital when an ambulance Is not needed and the 
transport can be safely done (hospital personnel are consulted for appropriate form of 
transportation). 

— Suspected closed type fracture to upper extremity without severe angulat^n. 

Other similar circumstances where this form' of transportation may be safely utilized 
without harm to the patient. 

— Center appointments and pharmacy needs if the patients condition is not life 
threatening or does not require special equipment and/or trained personnel normally 
found on an ambulance. - ^ 

Provider Relations 

Provider Relations is charged with the responsibility for MHMOP's administrative relations with 
the contract IPAs. This unit does not deal with matters of a medical nature. Matters of a medical 
nature fall specifically within the purview of the Corporate Medical Director. Provider Relations 
develops and maintains a complete list of all the MHMOP providers. The providers are listed by 
MHMOP contract IPA, specialty, and hospital. The type of information presented on the provider list 
for each center includes the following: 

1. provider's name and their specialty 

2. provider hospital privileges ' 

3. provider's telephone number 

4. provider's emergency on call telephone number 
^ 5. and provider's office hours. 

Attempts are made at all times to protect the provider's privacy. Therefore, departments within 
MHMOFs central office only have access to appropriate information from the provider list for that 
department. To facilitate the patient referral process at the primary care units, the Provider 
Relations Unit has developed a list of fee-for-service referral physicians. This list is made available to 
alNa^tract IPAs. 

Provider Relations Is responsible for communicating to each primary care unit MHMOPs 
administrative expectations of them. It is also the responsibility of this unit to keep each M^^BDP 
contract IPA apprised of enrollee complaints from enroUees assigned to their provider g^o)^ 

V 
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FINANCE DEPARTMENT 



. Activity and progress in a health maintenance organization may be measured by encounter 
statistics and costs associated with providing services per enrollee* encounter. The "Finance 
Department of Michigan Health Maintenance Organization Plans", Inc. (The Plan) is. primarily 
responsible for measuring the cost of services, ensuring that these costs are properly accounted for 
and participating in management policies and decisions as related to financial matters. In addition, 
all monies received by the Plan to pay for services to meriibers are processed through the Finance 
Department. 

The principle areas of activity can be summarized as follows: 

a. Cash receipts (capitation clWi^ks frpm governmental agencies or employer groups) 

b. Cash disbursements for — \ e 

Medical CQ3tsf 
Administrative costs 

c. Financial and special reports 

Each of these areas are of equal importance to the o^rall responsible financial management of 
the Plan. The Finance Department also has primary responsibility for dissemination of information 
that relates enrollee encounter statistics to dollars, and the evaluation of all financial management 
decisions. 

The following sections contain a more detailed description of the activities previously outlined. 



CASH RECEIPTS \ 

At the present time, the Plan has a contractual relationship with the Michigan Department of 
Social Services (MDSS)'to provide a designated group of Medicaid covered health care services to all 
Medicaid eligible persons who choose to join the Plan. 

For each Medicaid eligible individual that enrolls in the i^lan MDSS capitates, or pays, the Plan 
a pre-determined aipount of money. This pre-determined amount of capitated cash must be allocated 
to covgr those services which MHMOP has contracted to provide and most costs associated with the 
provision of these services. * ^ 

The monthly capitation check received from MDSS is budgeted for^the purposes described above 
and subsequently deposited into the Plants general checking account. 
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CASH DISBURSEMENTS 

Cash disbursements involves^ more than preparing and mailing a check. Prior to that activity 
many other tasks aPe performed. These tasks depend on' the nature of the costs being paid. 
Cash disbursementl^are summarized as follows: 

, i PERCENT 

Prepaid capitatioji to IPA (primary 

care cost) — fixed expense 45.2 

Fee- for-iser vice cost — variable expense 28.8 

Paraprofessional — variable ^5fpense , 5.0 

Administrative — variable expense \. 21.0 

I ^ 

100.0 

Prepaid Capitation to IPA — Fixed ^ 

The term capitates was used in the cash receipts portion above to describe the monies received 
from MDSS by the Plan. The term is also uSed to describe the prepaid monie^credited to MHMOP 
contract IPAs for providing primary health care services t0ft*lan members for which a particular IPA 
is resjionsible. The total MDSS capitation is paid to the Planl The MHMOP contract IPA receives a 
percentage of this capitation; the IPA also receives credit for consultation! referral ajid risk-sharing 
deductions that are withheld. ^ 

This mechan\sm is displayed in the following example. 



AMOUNT PERCENT 



Total capitation for members assigned v 

to IPA < 
Less consultation/referral retention 
Net capitation available for payment 
Less 15^ risk-sharing 
Capitation paid to IPA ' ^ 



$ 84.19 ■ 


100 


-12.65 


(15) 


71.54 


85 


-10.73 


(13) 


$ 60.81 


72 



Total capitation for members assigned to the IPA is computed by applying a rate to each of the 
various member <:lassifications. Specifically, J18.51 OAA, $28.25 AB, $21.33 AD, $7.88 AFDC over 
21, $8.22 AFDC under 21. In the example above, it was assumed that each IP3\ had one member from 
each of the above classifications resulting in the total of $84.19. 

A portion of the capitation is specifically designiitUj|ffj>g consultation/referrals. These monies are 



retained ih escrow by the Plan to pay for non-capitated he^j^ services that may be needed by a Plan 
member, but are not available at, the IPA. If an IPA physiSS^ decides that such a ^rvice is needed 
for a Plan member, he must refer that member to a physician or other health services provider that 
will provide the needed service (for example,' a neuro-surgeon W a prosthetic vendor). After the 
service is provided, the consulting or referred physician is paid from the escrowed funds. v 
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The Plan administers this fund on behalf of the MHMOP contract IPAs. At the encl of the 
contract period, the balance in the fund is paid directly to the IPA. 

Of the net capitation available for payment, 15% is deducted for risk-sharing to be used as a 
hedge against risk, a cost containment inducement or for the purpose of performing any of the Plan's 
obligations. If the cost of providing health care exceeds the MDSS capitation due to increased hospital 
costs or high utilization of hospital or emergency facilities, the Plan would pay these costs using the 
risk-sharing monies. If not used, the monies could be accumulated as cash reserves to cover potential 
^^excessive costs. The Plan may distribute unneeded portions of risk-sfeflrfing as a cost saving bonus to 
the IPA. 

In summary, the IPA receives the net capitation, the balance of the consultation/referral 

\ 

retention and possibly, by board decision, a portion 5f the risk-sharing. ^ 

*■ • ' 

Fee-For-Service and Para pro fessnosiaJ Costs — 'Var5able ^ 

Cost of hospitalization, prescriptions, ^consultation/referral and ancillary services are typically 
referred' to as fee-for-service costs contrasted with the cq^n tract ual capitation jcosts ofthe IPAs. 

Services that are rendered on a fee-for-service basis are l?illed directly to the Plan by the provider 
ofthe services. These bills are processed by the Plan's Claims Processing Division, where approval for 
payment is made. Upon approval, the claim is sent to the Finance Department for payment. 

Prior to payment, the approved claims are reviewed by the Medical Payables Section of the 
Claims Processing Department to insure tha^the claim ^as properly approved and coded. Payment is 
then scheduled based upon cash budget requirements, generally within thirty days. 

o 

MedacaB Costs 



( 



Costs of hospitalization, prescription drugs,' cbnsulting oijj-eferral physician services and ancillary 
services (such as ambulance or special equipment) are defined as medical costs. In the Plan's Multiple 
IPA Group Practice HMO, capitation payiVients to MHMOP contract IPAs are also considered to be 
medical costs. Each of these types pf costs results in a different processing procedure and are, ^ 
therefore, disbursed separately. ' . ' / 

- ADMINISTRATIVE COSTS — VARIABLE 

Every organization, health care or otFier, incurs administrative^ costs in order to deliver its 
services. The Plan is no e^cception. Payroll and ^elated costs are the largest cost element. Other costs: 
include rent and utilities, equipment leases, supplies, postage, informational and marketing, etc., . 
materials. v' ' ' 

The Finance Department reviews all bills received to determine that they relate to the Plan's n 
operations and have a valid business purpose. This review is facilitated by a procedure which requires 
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that all purchase of services or goods is approved in advance by a designated member of management. 
Upon com()letioK of this process, the bill is paid.. 

As an additional administrative costs control, corporate budgetary guides are observed. 
, \ Presently, there are varioug>s4eveU of controls to safeguard company assets. The mjyor items are 
listed below. ' 



ADMINISTRATIVE CONTROLS 

» * ^ *. 

Fixed capitated expenses and variable hospital-adminstrative costs ar^ controlled as follows: 

FiKed Capitated Expenses ' . 

MMMOf^s computer' printout identifies enrollees by category and MHMOP contract IPA. This 
eligibility list is compared to a second printout prepared by the Department of Social Services. 
. ^ The final eligibility li^t balanced by clinic and category (attached) is developed by comparing the 
MPSS printout with the MHMOP printout. 



Variable Expenses 
a. Administrative 

. ^ Purchase orders are used to control vendor purchases. 

,b. Medieal Fee-for-Service 

These^tiisbursements are authorized on P^ayment Authorization Form (PAF). (This includes 
hospitalization, prescriptions, consulting or referring physician and ancillary service, such as 
ambulance 'or^pecial equipment.) 

Check Signing 

All checks are reviewed for completeness and validity before disbursement from company funds. 
Authorization for completeness is the responsibility of the Finance Director. Authorization for 
validity is the responsibility of the Senior Executive Vice President. ^ 

Check* signing required two signatures from two of the following: 

1. President - any amount 

2. Senior Executive ^ice President - up to $600.00 

3. Corporate Secretary - any amount * • , 

4. Vice President Health Care Administration - any amount, . " 
Under no conditions can a check signer sign any check made payable tojiifnself 



> 
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^ FINANCIAL AND SPECIAL REPORTS 

As previously stated, a primary function of the Finance Department is to present and to 
communicate mlormation. Management needs information on operations^ wnich is provided Dy the 
income statement. Managerfient also needs information of financial condition. This is provided by the 
balance sheet. In addition to these reports, a variety of others are generated. Trend reports, which 
compare an activity for a period of time to a base period, analytical reports which disclose the 
composition of a*particular item, and other financial reports on an as needed basis. 

In addition to internal reports, the Finance Department works closely with the Plan's 
independent auditors. This is to insure that financial reports, received by those other than 
management, are accurate ar\d validly reflect the results of the Plan's fiscal operation. This 
, commutuality also insures that the Plan's financial position is properly stated. 

The Plan also files reports with the Insurance Commissioner and the Internal Revenue Service. 
These are informational reports -which are used to review financial soundness and the Plan's tax-fr^e 
stsffus. 

Although the Plan currently does not file a separate financial report with the MDSS, MDSS 
performs an annual audit. The purpose of this audit is to review the Plan's medical and 
administrative cost. The results of this audit are used to compare the Plan's cost to MDSS's cost. An^ 
capitation adjustments and cost savings are determined upon completion of this audit. 

The IPAs are directly affected by the MDSS audit. Th^ are requested and must submit an 
income statement for their IPAs (MHMOP) patient encounters on an annual basis to the MHMOP 
central office. The statements are summarized for a cost finding presentation to MDSS in connection 
with any revision of the capitation rates. 

) Careful budgeting an(|^cash planning, which insures an orderly and balanced growth, is a 
' necessity for an organisation growing as rapidly a& the Plan. The Finance Department works with 
the other Plan departments so that aH»-corporate activities can be translated into dollars. This 
facilitates a coordinated effort in the areas of financial planning, measurement, evaluation and 
management. 



Cost Savings Incentive ^ 

The Plaif also has a cost savings incentive agreement in it's MDSS contract. This agreement 
provides for the sharing of cost savings that may result if the Plan's cost for providing health services 
is lifespan the MDSS cost for providing the identical set of health services. At the end of each 
MDSS-MHMOP contract year, the Plan computes it's cost for provicjing the MDSS contracted health 
services. The Plants cost is compared to MDSS's cost. This computation is referred to as the adjusted 
average per capita cost. If the Plan's cost is less than MDSS's cost, this difference is viewed as 
savings to MDSS, a portion of which is shared with MHMOP. 

The following is an example of the adjusted average per capita cost comp^ation. 

38 , 



EXAMPLE OF ADJUSTED AVERAGE PER CAPITA COST 

MDSS 3 35.00 Cost 

MHMOP • • ' 28.00^ Cost 



Savings 

Enrol lee Months' 
Annual Savings 



7.U0 
200,000 . 



$1,400,000.00 



r 



MDSS 

\ 

MHMOP 

Savings 



Enrollee Months 
Aimual Savings 

0 



\ 

\ 



MDSS per'^capita cos^(cost to MDSS -for providing the identical set of 
health services which it has contracted with MHMOP provide for 
Medicaid eligible MH^OP enrolleie^) 

MHMOP cost for providing tfee MDSS contracted covered services. * 
Cost savings to MDSS which Results from provision 6f health services 
via an HMO mechanism to Medicaid eligibfe individuals rather than 
the traditional MDSS mechanism of providing the same services to 
Medicaid eligible individuals, j 

The number of mo iiths that each Medicaid eligible'individual has been 
enrolled in MHMOP times (x) the number of individuals enrolled. 

The amount of savings to MDSS wliich has rfesulted from contracting 
with MHMOP to provide health care'services. to' Medicaid enrollees. 



2il 
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ENROLLMENT BREAKDOWN 
' BY - 

Cj^TEGORY AND 'HEi^H CENTER 

(Effective Ji^Ty 1, 1975) 



















HealthX^ 
Center \. 


OAA 


• 

AB 


a6 


AFDC 
(over 21) 


AFDC 
(under 21) 


TOTAL 


' (#) 


McDougall- 
(01) 


4 


0 


18 \ 


z *- 

' 418^ 


1,^11 • 


1,851 


+11.98 
(+198) 


Metro 
(02) , 


. 3 


0 




285° 


952 


1,248 


+2.63' 
(+32) 


• Northwest . 
(03) , 


r — ■ 

0 


0 


11 


164 


535 


710 


—.84 
(—6) 


D.M. 
Associates 
(04) 


2 


1 


11 


594 


1,860 


2,468 


—.80 
C— 15) 


D.M.S.C. 
(05) 


11, 


0 


22 


895 


3,172 


4,100 , 


+8.52 
(+322) 


v.c:m. 

(06) 


1 


0 




339 - 


1,108 


1,451 


+4.46 '• 
(+62) 


Tri-City 
(07) 


15 


0 


19 • 


113 . 


365 


312 

f 


—2.66 
(—14) - 


Jeffries 
(08) 


4 




7 


r 

72 


276 


359 


(0) 


Detroit 
Family 
(09) 


14 


0 


16 


421 


1,515 


\ 

1,966 

7 


n 

+.10 

(+2) 


Puritan- 
(10) 


1 


.0 


4 




490 


677 


+15.53 

(tf91) 


Beech 

Daly . 
(11) 


1 


0 


0 


51 ■ 


158 


210 


(0) 

f 


Wilshire 
(12) 


4 


0 


2 


228 


725 


959 


+39.80 
(+273) 


MHMOP 


















/ 
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ENROLLMENT BREAKDOWN 
BY 

CATEGORY AND HEALTH CENTER 

(Effective July 1, 1975) 




cantor 



OAA 



4' 



AFDC" 
(over 21) 



AFDG 
,(under-21) 



TOTAL 



% 



Jefferson 
(13) 



273 



1,l42 



1,324 



+25.98 
(+273) 



W©w Li 
(14) 



(1i) 



362 



1,231 



1,606 



157 



555 



724 



X 



+6.64 
(+100) 



(—45) 



Oaklartd 
(16) ■ 



418 



1,408 



1,i 



4-2.00 
(+36) 



HodarJ 



23| 



975 



1,217 



+3.31 
(+3S) 



Zieger 
(18) 



3 



11 



537" 



1,719 



2,271 



—3.20 
(—75) 



Trail 
(1%) 



Prof. Plaza 
(20) 



22 \ 



29 



—75.21 
(—88) 



Infinite 
(+9) 



S & S Mjgd. 
' (21) 



0 



10 



34 



44 



+388.89 
(+35) 



TOTAL 



71 



168 



5,767 



'19,559 



25,568 



'+5.05 
(+1,229) 



Net Change 



V 



Last Month 



+5.97 
(+4) 



No 
Change 



-+9.09 
(+14) 



^5.56 
(+304) 



+4.86 
(+907) 
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PURCHASE ORDER 



michlgaii health saaintenanee organkatfon plans 

2200 WALKER C ISLE R BLDG.» 660 JONES STREET 
,DETROIT,MICH. 48226 . TE L. 31 3 A961 -3636 <, 



TO- 



DATE REQUIRED 



PtfAVf EwrtR OUP OROiP fOR GOODS USTH) UH O ANU NOTi»T u> »MMH»iAT!ii 



TIRAAS NET 30 DAYS 



API UNAHlf TO SHJP (OMPitfE OPDfP OAlC R£0'U««fO 



QTY. OaP D 



QTV. RgC'P 



STOCK r^UMIGe 



»NiT wee 1 TOuT 



ACCT. 01 ST. 



'1 

2 
3 
4 




\ 





OUR Of?OfB NO MUSI APPEAR ON Alt PAP£R<) AND PACKAGED PtlATIVt TO THIS 0RD6» 



STATEMENT FOR TAX EXEMPT PURCHASE 



"Michigan Heatth Maintenance Organization Piano, Inc., qualiflGQ for Qxcmption v 
under subooction (a) Soction 4a of the SalQO Ta« Act, and the itemo being pur* I 
hacod arc to be- usod or consumed in connection with tH@ operation of this \ 
ganizatlon. and that the conoidoratton for thio purchaoe moves from tho funda 
this organization. Tax exempt number 38-2031377". . ^ 



MCEIVEOOY 



PURCHA^NG ApENT — OATG 



2 i ■? 



PURCHASE ORDER 



T«-V6NBO«. CANABt- ACC0UNTIN8. PINK- PUHCHAStNO. OUANSS- NUMe«IC CONTIpl 
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PAYMENT AUTHORIZATION FORM 




I PATIENT INFORMATION 



-''-t - >^ *^ '^^t. ^ jC^\^-r^ti;l>2^t:^ ■■r>^ - 



II PROVIDER INFORMATION 



PACILITY OR PROVIDGR ^JAME 



MHMOP LD. C^O 



CITY 



TYPE OR OPECIALTV CODE 



ik^f'^S^^^-" * 'r':it:\^'^ ^l; PAY PROV: □ 



FACILITY CODE 



MEDICAID I.D. NO. 



ill PRIMARY PHYSICIAN 



IV ELIGIBILITY CERTIFICATION 



FNAMIi J ' 


I.D. CODE 








! - . f • ■ f 


LD. CODE 






1 ■/ 



SERVICE INFORMATION 



DATE ADMITTED 



HOOP. CAGE NO. 




A 


0 


C» 1 D 


E 


F 




H 


1 






L 


M 


DATE 

OP 
OERVICG 


LOCA- 
TION 
CODE 


TYPE PROCEOURe 

OP ^ ©efieRi>i^®N 

3ER\7lCe 


PROCE- 

DURE 

CODE 


QUAN 
TITY 




^ROyfDER 
C><ARGE 


ACCT.^ 
CODE 


APPROVED 
PAYMENT 


PORC^ 
CODE 


w 

CODE 
/(NP) 


LT^. . 
CODE 


REVIEW 
'ER'JS ' 
CODE 






3 7 




30 « ft 


4 0 4 0 




0 


» ft 


90 ft 0 


50 




00 ^ 


0 7 ^00 


0 0 7 0 


7 \ 
































a 






























ry ... 


n 
































\ 




o 


\ 
























-i 


































*1 * 
























DGCCRIPTtON OP ^ON^STIOS^ OR ©IAG^30SI8: 

. £i iUL 


'h 




TOTAI- 








^ . 




NO. OF cemosuf^EQ 



VI PRICING INFORMATION 




9ATG OJ. 
IN^ORMATS©?^ 
MTURNflD 



VII MEDICAL REVIEW 



•'Wll",-, 



MICHIGAN HEALTH MAINTENANCE 
L Q pRGANIZATION PLANS 



DOCUMENT NUMBER: 



I NO. 1 REV 11/1/74 



() co(9*e3 WHITE-PATIENT FILE, CANARY^YgT^S.PIN^-ACCOUNTING, ORANGE-PROVIDER 



MANAGEMENT INFORMATION 
SYSTEMS DEPARTMENT 
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^ MANAGEMENT INFORMATION SYSTEMS DEPARTMENT ^ 

The purpose of the Management Information Systems^ (MIS) Department is to function as a 
service department for all other areas of Michigan Health Maintenance Organization Plans, Inc. 
(MHMOP). / . 

The objectives of this department are to design, develop and implement a Total Health 
Information System to^meet the present need future demands of the community it serves. The 
ultimate goal is to improve the planning, control and scheduling of health care services which, 
hopefully, will reduce costs. TJo obtain these goals, the Management Irifprmation Systems Department 
has^ star^^d with the basic data required, to build a MHMOP enrollee healt^i DATA BASE. 
Specifically, this* basic data begins when enl-oUm^nt inforxftatjon is received from the enrollee at the 
time of registration. • . ^ 

" This initial data triggers the onset of bur.EnroUment^ystem which incompasses the enrollment 
preparation process, enrollee capitation computation reporting and medical record chart preparation* 
Prom this base, the systems department is able Jx) record all health cafe activity by enrollee and 
report in detail form all Fee-f6t*-Service (FFS) and MHMOP contract ' IPA services during the 
enrollee*s tenure ^in MHMOP. ^n additional objective is to report on all activities relating to health 
care services, pattern^ of care and those variables which enable us to monitor the quality of care. To 
do this efficiently requires the capability to instantly retrieve data. AU of the above is possible 

because of MHMOP*s on-line real time System which includes: 

» ■ 

1. Patient History 

2. Drug profiles - . 

3. Statistical utilization relating to data 

The three main sections of the Management Information Systems is the following: 

1. Computer Services - 

2. Enrollment Processing \ 

3. Medical Records Data Collection 



1. Compiiter Services ^ . / / >^ " 

Computer Services provides the necessary resources ta fulfill Management Information Systems' 
objectives of recording enrollment, keepittg'^track of enrollee activities related to health care and 
distribution of relevant information. It accomplishes these objectives by performing three basic 
functions: ^ 

a. data collection 

b. storing 

c. reporting 

Air personal data supplied by an enrollee,, health related services provided by each MHMOP 
contract ,IPA (prescription drugs, referral and hospitalization services data) are collected and 
converted to a form readable by a computer. Piersonal data is obtained fi^om the initial enrollment 



form. Service encounter forms whicfi are filled out by the pravidej group staffs provide* health 
services data. Other needed data is provided from fee-for-service invoices. 

Once collected, computer services supplies the capability for storing this tremendous volume of 
data. MHMOFs on-premises UNIVAC 90/60 computer has the capacity to file several hupndreci 
thousand records, and other data, within a very small space. Any portion of a record can be updated 
at an instant. The task of searching and examining a specific rfecord or reviewing the complete file is 
reduced considerably to a matter of minutes, rather than hours or days. 

Because of this special type of filing, each MHMOP enrollee record is made available on demand 
to autMMed users. This enhances the ability to respond rapidly to physician and management 
inquirie^Although random inquiries are possible, the files remain protected from undesirable querry 
so that the records are always kept confidential. 

Computer Serviced, through its reporting function, also serves as a central source of information 
for MHMOP and it's contract provider groups. Monthly printouts of mefhbership rosters' are produced 
to allow MHMOFs Central Office and MHMOP contract IPA staffs to identify enrollees eligible tQ' 
receive health services. This reporting function also enables an authorized user to 1^^^ specifi^ 
enrollee when and if the need arises*: Computer generated statistical reports, alsdTprovide MHMC^P 
with demographic data on MHMOFs enrolled population. Because these reports of each p^ient 
encoutiter traces enrollees activity, assessments can be made relative to health services accessibility, 
availability and continuity of care. Other printouts may be used by managemerit in predicting future 
demand for health care services by MHMOP enrollees. / 

Additional services provided via the computer are: enrollee correspondence, computerized check 
generation, and financialTeports. / 



2. Enrollment Processing 

The basic responsibilities of the Enrollment Section is to record, process, and file all enrollment 
and disenrolUnent applications. This Section is also responsible for the preparing and distributing all 
MHMOP enrolle^/identification cards. Telephone calls related to ei^ollee data changes, e.g., address, 
^lephone number, name, etc., are additional responsibilities of the Enrollment Section of the 
Management Information System. 
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3. Medical Records Data Collection 

The Medical Records Section provides technical assistance to the MHMOP Medical records 
division and MHMOP contract IPA personnel by explaining the established standards for an adequate 
medical records system. A second function of this Section is to assist in#the development ^^^uniform^ 
medical records system that will eventually be used by all MHMOP contract IPAs. 

The medical records kepf in the physician^s office are equally as important and should be given 
the same amount of attention as ^hose used in the hospital. Quality patient care and proper 
documentation of treatment is one*measure of appropriate medical record keeping. 



MHMOFs concern for its contract IPA's medical records system is due to the mandates of the 
federal HMO legislation, which suggests monitoring enrollee health outcomes. One method used to 
accomplish this objective is the collection and analysis of (non-confidential) medical records data. In 
addition, the MHMOP must adhere to federal, state and local regulatory guidelines for medical 
records. These regulatory guidelines include: ^ <- \ 

a. "Maintenance of an individual medical record for each enrollee which should* contain the 
following information on the enrollee: 

(1) health history 

(2) - family history 

(3) social history 

(4) physical exam 

(5) other pertinent information 

^ b. Development sfnd maintenance of a chart order for material in the medical record. 

Establishment of a reporting r^chanism for services rendered to each enrollee" (MHMOP 
Encounter Form). ^ r 



c. 
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THE PRIMARY ENCOUNTER FORM 



When an en^Uee visits a MHMOP contract IPA a "Primary (MHMOP) Encounter Forn\" tlge^^ 
to report all categories of services of services provided, e.g., office visits, in-patient visits, 
immunizatidns, x-rays, laboratory tests, etc. The Primary Encounter Form is designed to provide^data 
for patient encounter reporting requirements. * <^ <> 

The following is a description of and instructions for completing the Primary Encounter Form. 

/ , - ■ ■ . 
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PRI\fARY ENCOUNTER FORM 

n Section I, of the Primary Encounter Form enter the patient's nine digit MHMOP m^dic^l record number 
d the patient's full name as shown in the example below. 



PATIENT INFORMATION 



\ 



LAST NAME FIRST 

DOE JCM\ 

PATIENT IDEI^iT(t^!CAYlO(SJ NUMBER 



MIDDLE 
A, 



12-345678-7 \ 

Jn Section II, of the Primary Encounter Form, print your Center's identification number and name and the 
l.l) number and name of the physician providing services to the MHMOP enrollee as shown in the example below. 



II PROVIDER INFORMATION 



PROVIDER CENTER NUMBER AND NAME 
12 - WILSHIRE 



PROVIDER ID NUMBER AND NAME 

03 - SAM SMITH. m'.D. 



In Section III, of the Primary Encounter Form, print the date of service of the services being repoi'ted in the first 
block on ibe left. Use the next three blocks to indicate the appropriate faur digit H.I. CD. A. primary, secondary 
and additional diagnosis codes. The appropViate diiagnosis code should be selected from \\\t eighth revision of 
the huernafional Classification of Diseases, adapted for use in the United States as pubTished by the Commission 
on Professional and Hospital Activities, Ann Arbor, Michigan, second edition, Septejnlj^zT 1973. If the services 
bcinu reported took place during a hospital inpatient admission, indicate the **daief admitted" and the ''^date 
discharged" in the fifth and sixth blocks. In the seventh block indicate whether tfievpatient's visit is by appoint- 
ment, walk-in or no-show. The status code blocks are used \o indicate the Michigan Department of Social Services' 
**status code" which indicates the status of the problem (diagnosis) being treated by the physician if knpwn 
i.e., I ). acti\e, 2). controlled, 3). preventive, 4). resolved, 5). ruled out, 6). redefined, 9). unknown. 
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1 SERVICE INFORMATION 


DATE OF 
6ERYICE 


H-ICDA 
CODE # 1 
> 


STATUS 


H ICDA 
CODE #2 . 


STATUS 


h-icda/, 

CODfe 


STATUS 


DATE 
ADMlTJEe 



DATE 
DISCHARGED 


APPOINTMENT 
STATUS 


1/10/7 


3 412/9 


1 






~ \ 




12/15/74 


12/24/74 


WALK IN r 
NO SHOW 
OV APPT ( 





The middle section of the Primary Encounter F^j:frfcontains a list of the most common physician services 
provided to MHMOP enrollees. Check the ai^J^O^iate block accordiAg to the services provided by the physj^ 
cian. In Section A, use the left hand columtvf^r established partients anlj^ the right hand column for new patients. 
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OFFICE VISITS 
Brief Service 



ESTABLIS' 
PAT I EN' 



NEW 
PATIENT 



Limited history exam and treatment 
Intermediate history exam and 
treatment 

Comprahensive history'and e«am 
includtfTg initiation of diagnostic 
and treatment program 



5 Periodic Medical Evaluation 
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□ 
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I. RFHSUn PRIMARY ENCOUNTER FORM (continued) 

If laboratory tests have been requested in conjunction with the patient's office visit, check-off the appropriate 
tests as shown in Section B,' below. 

y B LABORATORY SfRVICfC 



1 Aitium'" 


□ 


19 


I Dm 


□ 




A)h Phos 


n 


^0 


Mono Test 


□ 






□ 




Pap Smear 


□ 




4 *Bii'fubin 


□ 




Phosphorus 


□ 




Blood Group 


□ 




ProthrOfT^bin Tirr^e 


□ 




h Hiocirt Type 


□ 




HuU'Ma 


□ 




f BUN 


□ 




StD Rale 


□ 




M ( ,iif um 


□ 






□ 




i ' 




,» / 


S(.PT 


n 






□ 




Si. ( .1 l'ft>p 


□ 




. [ PK 


n 




T < ! 4 1 


□ 










r/.f Prol*")" 


n 






D 






D: 




J fBS . »* ', 


□ 




A<,.I 


D 






□ 


1 ) 








ih (.,f.jrn ',(.1 f 


□ 




'O 




. • If.rl ( iK)mh*. 


, D 




WiM Pr,.p 


B 






' □ 











It the palicni has been h^spUati/ed for the condition the primary physician has been treating, indicate the 
**numbcr** and **iype'* of visits to the patient in the hospital the physician has made, in the-manner shown below, 
h is important, for ttcms 3-5, below, to indicate the exact number of visits made by the physician. 

Scciions I) and E, of the form are used to indicate the types of injections, x-rays and other types of services 
pj^nidcd to the c^rollee. If an appropriate H.I. CD. A. diagnosis code cannot be located, a written description of 
the diaiinosis should be provided in the remarks section. If the physician would like the patient scheduled for 
another \isii the approximate date of that visit should be entered in the lower right hand corner of, Section III; 
Serv ice Information, of the form. 



OCWCKARY MEAPrr DISUSE, 



If the service provided to the patient is not listed in Section III of the Primary Encounter Form, it must be 
entered in Section tV; Other Services, of the Primary Encounter Form. 



IV OTHER SERVICES 



oatc of 

SERVICC 


LOCATfOM 
CODE 


■nrPE OF 

SERVICF 


CODE 


QUANTITY 


Oa^RIPTtON AND RCMAPIKS 
<^oqu;fod only il no pfocctluro coda c«n bo found) 














VlO/75 


2 


2 


1570 


i 


Aneotheoia: l/xal 


JL/X0>75 


2 


3 


7200 




Profesoional ConDOiysnt of Spinal X-ray 


1/10/75 


2 


1 


1570 


1 


Surcfery - Drainana of Infectad Bwna * 















The date of service and the^propriaie Michigan Department of Social Ser 



location, type of service and 



procedure codes ;=>hould be entered in this section of the form according to the instructions provided in Appendix 
F, Pages A-24 through A-35, of the M.D.S.S. 's Practitioner Manual. 



Location Codes: 
I.— Home.' 



2.— Office. 



Type of Service Codes: 

Q -Teclinical Surgical Assistance. 
£ |^(^- Anesthesia. 



3. — Inpatient. 

3.— Professional Component (reading of x-ray by radiologist) 
9.— All oth^r services. 225 . * , 
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PRIMARY ENCOUNTER FORM (continued) 
The amount of the capitation payment that MHMOP receives from M.D.S.S. is determined in part by ihey^ 
amount of patient services provided by our health care centers. If all of our centers do not accurately, completely 
nd promptly reFX)rt on encoOnter forms all services provicfSd; this carJj-esult in capitation payments in^^mounts 
-ess the MHMOP is entftled. We hope the* above "described simplified primary encounter reporting-i^ystem will 
encourage more prompt and accurate reporting by MHMOFs Primary Health Care Centers. / ^ , 




PftlAAARY ElMC OUNTER FORM 



PATIENT INFORMATION 11 PROVIDER INFORMATION 



III SERVICE INFORMATION 



MCDA < 
COW » »^ 




MCOA 
fOt» '2 


SIAIUS 


MCOA 
COCJ # J 


SI*IU3 


D*It 





















f MK K AfPI It *Hl I HI I J< X*! / 

n f] 



6 N^Dr," , 



r'i 
f u 

n 

L"I 
[ '] 

'.J 
■ J 

n 



n 
n 




IV OTHER SERVICES 



1 DATE of* 


lOCATtON 


Tin or 


^QocfOunc 


OUAWTITV 


1 - smvicr 


COOC 




CODS 










r 




1 


i 
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PHYSICIANS' RESPONSIBILITY FOR MEDICAL RECORDS 

The physician is responsible for the qualitative review of a patient's medical records. They 
establish the standards that wil|^controL the quality of he^dth care rendered. 
C The medical record should be sufficient in detail to ienffble authorized , reviewers to determine 

what the patient's condition was and what procedures were performed. The medical record should also 
-enS^ble a physjcian, not currently treating the patient, to assume responsibility for that patient based 
^ on information contained in the medical record. 

Occasionally, MHMOP c(|i^t4ct IPA physicians may wish to delegate the task of the insoection of ^ 
' medical records for completeness and consistency to a qualified MHMOP medical re^^rds ihsV^tion * 
team. For examples, inspection of the medical record to see if it is properly assembled, or if all the 
reports of medical er^counters are present and accounted for in the proper sequence. ^ 

MHMOP'S RESPONSIBILITY FOR MEDICAL I^ECORDS 

I. MHMOP hB8 contractual arrangements with MHMOP^ contract IPAs to provide the following: ^ 

1. a list of;,^ible MHMOP enrcillees 

2. pre-numbered medical record charts for each enrollee 

3. the basic forms to be used forci^e medical record chart (e.g., health histgry, physical exam and , 

ff t. 

progress note) . 

4. patien^ncounter reporting forms 

Each MHMOP enrollee is assigned a number that correspoSids to the number of his medical ^ 
chart. This number represents the enrollment nunfeer as well as the medical /record number. Each 
enrollee . is also issued a computer gener^ed identification plate which consists of the following 
information: . ^ , 

^ a. Enrollee's name 



c. Age 
Jd. Birthdate 



e. . IPA number ^ 

f. Medical Records Number 
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RECOMMENDATIONS FOR MEDICAL RECORD MAINTENANCE 



The Medical Records Sectipn makes recommendations, time and pe^Bonnel a^vailable to MHMOP 
contract IPAs for Medical Records review and evaluation. The MHMOP Medical Records staff suggest 
that location and facilities for medical records should be selected to provide:- ^ 

a. prompt medical record services for the care of all patients i 

b. adequate space for records, personnel and equipment 

c. An efficient and safe means' for circulating re5prd(s thpughout all stages of their use and 
completiozf ' , ^ 

Periodic inspection of the mediCal record files should be made to assess if they are in the proper 
alphabetical or numerical order. A chart order should, be established for the contents of the records. 
•Backing sheets should be used for laboratory reports and there, should be consistency in the size and 
shape of the for;ns- and reports in fhe medical record charts. The periodic inspection of the medical 
records "should be the responsibility of a specific personCs). This inspection serves as ^ control measure 
to keep MHilOP contract IPAs informed of how well its medical record files are being maintained. 
Information obtained from the inspection is used as a guide in determining whjat pction should be 
taken and what priorities should be established in regards to*tl^IPA*s medical recprd system. There 
should also be a mechanism for corrective action whenever it is needed. In some instances, nothing 
more than better communication is required. In Dther instances, fiSVmal or informal training programs 
to improve an IPA's medical record staffs* skills is required to correct the medical Vecord difficulties 
encountered. ^ ^ ^ 

The Medical Records Section of MHMOP is equipped to offer graining programs to MHMOP 
contract I^s Medical Record StafT if an IPA requests this training. If this type of training is desired, 
IPAa may contact the Medical Recdrds' Staff at 961-3636. 
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cAPPENDIX 5 — "Evaluation Design" 



EVALUATION COMPONENT DE5SIGN 
FOR THE DETROIT MEDICAL FOUNDATION 
DEMONSTRATION TRAINING PROGRAM 



Submitted by 
TARP, INC. 
July 15, 1975 
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1. INTRODUCTION - 3 ' . ' 

Technical Xeliistance Research Programs (TARP), Inc. has contacted with the Detroit Medical 
Foundation to conduct an evaluation of the Demonstration Training Program for Primary Care Ujaits. 
This evaluation will ^onsist of two eq§iponents. 

• A process evaluation will document the oriepis of the project, planning activities, and the 
project*s implementation. TJie objective of this ^i^attiation component' will be to' orient others to the 
training program experience, to indicate strengths and weaknesses in the traihi^ig experience, and to 
suggest wayB other HMO's could launch their own trailing e^orts. 

* • An impact evaluation will judge the efTectivenesd of the training methods and curriculum when 
developed and applied. This objective will be accorhpli&hed by assessing the nature and magnftude of, 
changes in levels of information, and attitudes (perceptions) among participants in the training 
program before and after undergoing the training experience. ^ 

& 2. TRAININGTROGI^AM OBJECTIVES 

The major objective of the Demonstration Training Program is to improve the tevel of kno^atledg^^ 
and information about important operational' components of the Michigan HMO Plans, Inc. amo^ 
the staff of selected primary care unit&(PCU) in attendance at the project')^ training seminars. ! 

There are four sub-objectives to the project: . 1 

p To improve the level of knowledge about the difference between health maintenance 

organizations and traditional forms of health care delivery ambng PCU staff. 
U To improve the ability of PC Us' staff to identify their responsibility to \he mcyor divisions of 
^ .Michigan HMO P^ans^d the policies and procedures of the divisionAvhich affect the PCUs. , 

• To improve the level of >CU staff understanding of%uhat the Michigan HMO Plans has to 
offer its member PQTJs. 

• To improve the ability of the PCUs* staffs list the major divisions of Michigan HMO Plans 
and the areas of responsibility of each. major division. 

3. UNDERLYING PROBLEMS AND ISSUES . . 

The m^i^M* and sub-objectives of the Demonstration Training Program address problems of 
information communication and exchange which necessarily exist among units of any new complex 
organization. Because an HMO represents the conversion from traditional to non-traditional modes of 
health care ,deli very, -participants in the transition necessarily require large amounts of information 
and guidance if they a^re to c(MXform long-standing behavior patterns and attitudes to the new frame 
of reference. ' \ - * " . 

Each training program suB^objective identifies a critical area of information and communication: 
a) that Michigan HMO Plans Central Office must cleanly communicate to the members PCUs the 
operating policies of specific Plan divisions; b) that each PCU must learn what specific actions are 
required in order for them to conform to the operating requirements of each division; c) that each 
PCU must be made awar« of the kinds of* supportive services available through the Plan; d) finally, 
that Plan Central Office personnel must become sensitive to problems and issues being faced by 
PCUs'and offer solutions to {hese problems. 

4. trBning program methodology 

Each of the four sub-objectives is being operationalized through the curriculum component for 
inclusion in the training seminar. Three data collection procedures have been utilized to both design 
the curriculum and to provide a baseline level of extant knowledge and information, fi-om which to 
assess subsequent ch^pges. ^ » 

^ An information prhtocol, aUaady in use s^t Michigan HMO Plans, which periodically* appraises 
levels, of information present among PCU and Central Office staff, was tapped into, in prder to assess 
information levels prior to the im^len^entation of the training program. 

A ne^ds^ssessment protocol was utilized at three PCUs to get staff'inputs into what topics they 
thiak should. Be covered in the training program. 

A state-of-the-art literature review assessed training programs and the HMO literature, gleaning 
relevant^information for the curriculum. . < 

These three data sets are serving as valuable inputs to curriculum design. Accompanying the 
•design of the curriculum is- the development of training materials, procedures and formats. Together, 
the curriculum, training materials, procedures, and formats constitute an integrated demonstration 
training seminar, which will be conducted July 25-27, 1975. ^ 

• ' . . i ■ 1 2^0 , ' ■ ■ ^ 
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5. EVALUATION COMPONENT METHODOLOGIES - ^ 

5.1 Process ]E valuation Methodology s ^ / * I 

The process eval^^ion for tliis project will consist of a detailed narratwe documentation^ all 
aspects of the orUfm6|7plannijflg, and implementation of the Demoniitratipn Training Program. 
Members of the TARP evaluat*iro te^m*1ielped design the original proposal in March, 1974 and have 
'observed all ^snificanit planning meetings during the project design phase. In addition, transcripts 
are available^r all major planning sessions. The docuinentation record, then, is quite extensive. 

The narrative record of the ^project'a#genesis v^l be critically reviewed by TARP in order to 

highlight significant -^obl^ms experienced by the DMF tean^, how tjiey wer^ resolved, and 

implications for the planning and* development of training programs by other HMOs. 

* 

5.2 Impact Evaluation Methodology 

Evaluation, broadly speaking, is a Systematic, controlled research effort which collects and 
analyzes data to test if a specified, or "expected^ change has taken place as a fesultfof the training 
activity. » ^ 

This definition immediately suggests thl^ required research design, data elements and the form of 
analysis in order to conduct the present impact evaluation. 

The research design required is a pure experimental iwesign which establishes the presence, or 
absence, or the level of the relevant objects of analysis at tne beginning of exposure to training and at 
the end of the exposure. The comparison of the "before anjj[ after" statuses pi^vides the measurement 
of impact or change. The analysis is concerned with arriving at a judgment that the change (or the 
impact) found in the "before and after" comparison is the expected one. 

The attribution of the impact to the "stimulus", that is^ the training experience, depends on the 
ability to assess the aspect or 'Joortion of the observed change that is due to the effect of all othef 
everAs, /Mperiences, and changes that occurred to the individuals being trained. This "control" is 
achieii^d by a "before and after" study of some individuals firom the population undergoing the 
training who^are deliberately not exposed to 4he training effort. Any "before and aft^r" differences 
found ^n this control group is attributable to all other factors which operate on the total populatien' 
during the training time period. Consequently, a comparison of the change found in the experimental 
^and the control groups identifies that portion of the observed change in the experimental group which 
is no^ attributable to the training. 

The data elements that are required for the "before and' after" assessments are defined by the 
changes that are to be measured. The data units v^hich provide a before and after status are the 
relevant ones. , ' ^ 

5.3 Specific Requirements of the Impact Evaluation 

Ihe objectives of the training effort are not limited to the acquisition of defined pieces of 
knowledge; they -also relate to a change in the relationship between the personnel in the Primary 
' CareXinits and the staff at^the Central Office. The change in this I'^lationshipMs a change in the way 
in which interaction occurs and involves changes in perceptions and attitudes betweGJi PCU staff and 
Central Office staff. The change is to be bi|^ght about by deliberate involvement of the f^vo^oups in 
a common planning proqess — the developi^ent of the curriculum — and the imparting of infori^ation 
which will fill gaps in existing knowledge and correct misinformation. The areas selected for this 
"teaching" effort are perceived as relevant to the current sets of attitudes and perceptions of the two 
groups; and it is expected th^t accepting new or cojrrect factual information will facilitate changes in 
attitudes and modes of interaction. ^ ' ^ 

6. IMPACT EVALUATION DESIGN REQUIREMENTS > ^ ^ 

The specific research design was developed to accommodate the nature of the training methofjp 
The method consists of 1) involvemen^i in the design of the curriculum, and 2) participation in the 

training. ^''"^^ " i> 

> The experimental groups are tire central office/'decisionr maker" level st^ff and staff in the PCUs 
Vvho are involved in direct delivery of care and interaction with the Central Office. 

'Ae impact measurements must assess attitudes, modes of interaction, and degt-ee of correct 
information before and after the training e|]fe|J. ^ 
Following are the specific phases of the proposed evaluation design. 

\ . 
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7. PROPOSED DESIGN ' ^ , ^ 

^ Figure 1 presents the structure of the total evaluation and 4;he groups ihvolved in each 
evaluation component. These groups are the various members of the-MHMOP organization, 
structured as follov/s: - ' 

• Group A: The staff of 3 PCUs who participated in the needs assessment and training 
conferepces. ^ • 

• Group B: The staff of 3 PCU^ wlw di<} not participate in the needs assessment, but did^ 
participate in tlie training conferences. 

• Group C: The ^taff of 2 PCUs selected for ''control group" purposes, neither ^involved in i:he 
needs assessment nor the traihing conferences. , * 

• Group D: All MHMOP staff and .consultants, utMized as faculty and trainers for the training 
conferences. * , 

These groups will be arranged into a quasi-experimental evaluation design. An explanation of 
this approiach follows, keyed to each step^outlined in Figure 1. , \y S 

(1) — (3) PCU study grgups and Central Office group are identified and selected.^^ ^ 

(4) PCU study, groups are divided into two experimental groups C'A" and "B") and group ''C", a 
control group. The experimental group "A" will be involved in the two major activities: planning the 
curriculum (through needs assessAient) and training. Group "B" will be involved in the training 
activity only and not in curriculum planning, so that group "B" will serve^as a control for group "A" 
for assessment of the impact of involvemcfnt in planning the curriculurri/Group "C" will serve as an 
overall control, hot participating in either planning or training. /\ 

(5) — (6) Tlie data colteption for the "before" or baseline assessment V^st be' completed before the 
two phases of the training process can begin. Analysis (6) consists of comparisons among the four 
groups^as to their Responses to the information protocol. Levels of knowledge about ''MHMOF' will be 
record^. Group "D" will be asked to assess knowledge levels of Groups **A", ^*B" and "C". 

(7) — (8) Phase oce oft the training effort — involvement in curriculum design, er participation in 
"needs assessment" — is now instituted and completed. Groups "A" and "D" are involved in this 
phase. Data analysis (8) consists- of determining what each group thii^ should be included in* 
training curriculum and comparing differential perceptions between groups *A" and "D". 

(9) Next, groups "A", "B", and "D" are exposed to the second phase of the training effort. 

(10) Data collection for assessing the "after" or "outcome" status is n5w instituted, groups "A", 
"B"^ "C", and "D" are included. 

fll) Additional data for '^outcome" assessment will now be collected for "A", "B", and "D". A 
further set of data is collected for "D". The first set of data will assess changes due to participation in 
phase 1, the needs assessment and curriculum planning, (groups "A", "B", "D"). The second set will 
assess Jbhe effect of participation in the training for group "D". 

(12) The final step will be the analysis of the body of data collected so that (a) "before*' and 
"after" statuses can be determined, (b) impact, if any, can be described and (pwssibly) attributed to the 
two training phases. 
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ACTIVITY 



QROUTP INVOLVED . 



1) doHfe^Dreliminary 
informalion fi-om all 
PCUs 

2) Determine selection 
criteria for selec- 

^/tion of stud}^ PCUs 

W Select PCUs 



) Seiect 3 study 
groups 



5) Administer in- 
formation protocol; 
"Before" (1^ 

/ 

6) Analysis I 



7) Needs Assessment 

8) Analysis II 

9) Training Seminar (1) 

10) Administer iMqiT: 
mation protocol, 
"After" (2) 

11) De-briefing 
Training Seminar 
(2) 



12) Analysis in , 



All PCUs; Central Office staff 

All PCUs; select 8 PCUs firom total universe 

6 

' . / 

Selected 8 PCUs divided into: A=3 fCUs B=3 PCUs G=t2^^CUs 

A= Involved in B=not involved in C^Control — no involve 
y planning and k planning; involved ment in training or ' 
training ' in training planning 



B 



D= Central Office 



Each of 4 groups with each other, also A-hB^C, ' 
A-hB-hC^D, A+B^D, MB^MCi. MD, B^C, B^D, C^D 



A 
A D 
A ^ 
A 



B 
B 



Repeat Analysis I and Analysis. II, i.e., A,D relative to II. 



D 

D 
D 

D 



ERIC 



BIGURE 1 



^233 

'4 



8. EXECUTION OF THE IMPACT EVALUATION 

8.1 The4>opulation 

y> 

(\f§taff from PCUs. The MHMOP encompasses twenty-one PCUs which afe under ^ variety of^ 
contracts, vary in size, staffing, type and range of medical specialization, and length of time affiliated. 

A decision had to be reached whether all the individuals, regardless of professional status or type 
of work, should be considered as a "pool'* from wl^ich a sample ^w^ to be drawn -for inclusion in the 
training project, or whether the PCUs as such should be considered the universe. It would be 
necessary to select only a limited number of individuals for the tr^imng session since first, funds 
would not cover accommodation for all and, further, not everyone couJjRfe spared "sipce services to the 
enrollees must, necessarily, continue. ^ ' 

It was decided to select the PCU as the unit for selection since the functioning of units is of 
primary interest. The Central Offic6 and the individuals in th^ PCUs relate to each- other in terms of 
PCU identity, not as individual members of a uniform system. ' ^ 

Data was collect^ on each PCU in^ terms x)f its type of services — speciality or general services 
— , length of functioning, types and numbers of personnel. The Board ahd administration approved a 
suggested list of eight PCUs to be included in the training project. These selections were based on 
five criteriax^ maturity of the PCUs; willingness of t^^e PCUs to cooperate in the project; size of the 
PCUs staff (can't be too large so all may participate); -fimd lack of staff conflicts. V 

2) The Central Office Executive/Administrative Staff. Group D consists of those Central Oflice 
staff who will ser,ve as instructors in the training seminars. 

^ William O. Mays, M.D. ' President 

W. Melvin Smith, M.B.A Senior Executive Vice Presi^lent 

O. Lark^i Isaac, M.B.A. Director of Operations 

Sandra Billingslea, M.S.W. Martager, Health Care , 

Administration Division 

Bruce Mullican Manager, Claims ^ / 

Processing Division^ 

Fred Prime ^ Director of Market mg 

Karl Haiser, C.P.A. Director of Finance 

Barbard Sue Brown Supervisor, Subscriber Services 

Andrea Williams • Supervisor, Enrollee Education 

Alegro J. Godley, M.D. Director, Corporate 

\ Medical Planning 

Jack Conway, M.B.A. Health Systems Analyst 

Dorothy Douthitt, A. R.T Medical Records Librarian * 

8.2 Data . 

The data to be collected must permit assessment of knowledge and attitudes as well as type of 
interaction. Some of this data can be obtained only through direct observation; some from data 
obtained more systematically by tapping into MHMOFs periodically administered information 
collection system. f"" 

1) Information and attitudes. MHMOP periodically gathers baseline data from both new and 
long-term PCU staff in order to assess levels of staff information and to pinpoint problem areas 
requiring resolution. In order to? utilize this on-going data collection instrument for the 
Demonstration Training Program, the most recept data from the eight PCUs involved in the project 
was pulled from the files and analyzed. Analysl^of responses to the information protocol for the 
non-participating PCUs will also be available for dompa|;ison. 

The information protocol probes for levels of information about HMO activities an^^ternlines 
attitudes towards the Central Office held by PCU staff. 

Group D, the Central Office trainers, also are responding to the information protocol. These 
individuals are being asked to estimate the response distribution to each item that they believe will 
,be elicited from PCU ^aff. In other words, Central Office personnel are being asked to "second guess" 
information levels present among PCU staff. 

In addition, group D*s attitudes- will be assessed by an analysis of the tapes and records of several 
planning and working sessions with TARP personnel. These sessions dealt with overalrplanning at 
the project, the development o£ the curriculum, evaluation, practical details of scheduling, 
requirements for the workshop, et/ . 
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9. THE ANA^SIS OF THE IMPACT EVALUATION 

The analysis will consist of establishing "before" status and "after" status of the varit)us groups, 
and the coinparison& of "before and after" statuses. 

In addition, for both the "before*^ ajid the "after" statuses, there wiUBe the following comparisons 
to assess the poasibility of projecting data for group A onto all PCU*s. Therefore, the following' 
comparisons will be possible: - v 



A-B 


A-D 




B-D 




C-D 


A+B+-C 


A+B+C-D 




A+B-D 



\ 



{ 



D before ^ after 

10. THE COM^UMER PANEL 

No systematic data v/ill be availal^e but, general assessments of conflicting expectations ahd 
degree of khowledge will be presented as a dimension of the analysis. 



f 
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APPENDIX 6 
YOUR OPINION PLEASE 

PLEASE CHECK THE APPROPRIATE BOX FOR EACH ITEM BELOW: 

1. The information given during the conference was: 

a. too much just Hght not enough 

b. _ very helpful somewhat helpful not helpful at all 

c. very clear okay . confusing 

y. interesting all right boring 

2. ^jat^^r^check mark by the one presentation you liked best in Column A and a check mark by the 
one presentation you liked least in Column B. 



TOPICS COVERED 



LIKED BEST LIKED LEAST 
Column A Column B 



a. "What is an HMO?" 

b. "Prftient Rights" 

c. "How Michigan HMO Plans, Inc. Operates" 



h. 



J. 



k. 



"Health Services Available via MHMOP Central 
Office Referral" 



e. "Fee-for-Service Utilization" 

f. "How Michigan HMO Plan is Marketed" 



(PHYSICIANS ONLY) "Financial Structure 
of the Plan" 

(PHYSICIANS ONLY) "Effective Patient 
Management" 

(PHYSICIANS ONLY) "Corporate Dental 
planning for MHMOP* 

(ALLIED HEALTH PERSONNEL ONLY) 
"Account Executive" 



AHP ONLY) "Enrollee Orientation" 
1. (AHP\0NLY) "MHMOP^s HOTLINE" 
m. (AHP 61SILY) "Enrollee Concerns" 
n. (AHP ONLY) "Medical Records" 
o. (AHP ONLYr^MHMOFs Encounter Form" 
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3. Is there any tdpic or subject that was not covered that you think should have been covered? 

CIRCLE ONE^ . YES NO 

, If YES, describe TOPIC. ■ 



4. • Is there any topic or subject that was covered which could have been left out? 
.CIRCLE ONE YES NO 

If YES, describe TOPIC 

5 a. Please indicate your Primary Car^ Unit on the line below. 

PCU # : 

Please indicate yonr function in your health center by checking the appropriate box. 

□ Patient Care: Physician 

^ □ Patient Care: RN, LPN, Medica^Assistant or Aide, Receptionist 

□ Office : Administrator or ^Administrative Assistant, Manager, Typist, Clerk, Secretary, 
Billing, Accounting, Bookkeeping 

□ Other: Medical Records, Laboratory or X-ray Technician, etc. 
6. Other Comments. 

/ 
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APPENDIX 7 — "After" Questionnaire 



PHYSICIANS 

r. Following are some tSrms; for each, there ai;e several definitiong. Place a check in the box 
next to the one you think is most nearly correct when used in relation to HMOs. 

a. Capitation (for HMOs) can be defined as: 

, . □ 1. An insurance premium, of which the amount depends on vyho the enrolled person is. 

□ 2. Some fixed dollar amount paid per enrolled person. 

□ 3. A predetermined fixed dollar amount p^iid per enrolled person for a fixed set 

(package of services). Q 



B. Physician Fee-for-S^rvice Feature of HMOs is: 

A portion ,of the funds which pays the h 
(doctors) who are classified as consultants or specialists. 



□ 1. A portion ,of the funds which pays the higher compensation rates^ of menibers 



□ 2. The usual and customarjf payment to the physician specialist on a referral or 

approval basis from the primary care physician for covered health services. 

/ . ^ 

□ 3. A portion of/ the funds which pays for physician services rendered to the patient 

while in hospital. ^ 
C. Risk Sharing in HMOgi ' * * 

□ It^ Is a form of maloractice insurance. 

□ 2. Means that any deficit incurred by your health center will be directly paid by your 

group and your group alone. ^ 

□ 3. Is a bortion of the total capitation set aside into a reserve fund to cover unforseen 
* financial hazards for the plan. 



— Continued — 
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D. Benefit Package in HMOs: cv 

•* ■* 
□ 1. An identical range of health services "wtiich are guaranteed by MHMOP, regardless 
of the medical group in which the individual is enrolled for care. 

n 2. The range of health services to which ^an enrollee is entitled an^which is defined by 
the individual medical gro^p contract. ^ 

n 3. Tho^ejiealt^-^ervices deemed necessary by the patient's physician. 

E. Referrals to Specialists who are not under a capitatpn contract with MHMOP are paid 
for by: . 



n 1. The group to which the doctor making the referral belongs. 

n 2. Out of capitation with prior approval of MHMOP. 

n 3. Out of the risk-sharing fund with prior approv^al of MHMOP. 

n 4. Out of the fee-for-service with prior approval of the medical group. 

□ 5. None of these. {Please describe your understanding of this payment arrangement). 
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II. A. For each of the items below, check the column which y6u feel is appropriate. 



i 

Health Service 


.A. / 
Included in basic 
kMO Package and 
available to 
enrollees 


B. . 
Can be made^ 
avaitkfele if^ 
needed ordered 
by physicians 


• C. 
Not provided 
by HMO contract 
under any 
- circumstances 


D, 
Don't 
Knov7 


1. ' Prenatal Care o 










2. Eye Glasses 




J 






' 3. Plastic 

Surgery ^ 
(cosmetic) 1 








0 

-< • 




4. Outpatient 
XRay 
Studies , 








• ^ ; 

•a 

!" — ^ 


5. EKG&.EEG 






f 


— ^ 


6. Abortions , 


1 








7. Deqtal Care 


XT. — ^ ^ 








8. Psychiatric 
Care 

Outpatient 






\ 

♦ / 




9. Contact 
Lens 


— N 


1 


/ 




10. Emergenc>^ 
Room 
Services 

/ 











^ ■ 
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/ 



—■ ^ 


A. 

Included in basic 

available to 
enrol lees ^ 


^ ^ B. 

^ / ' 
Can be made 

MvnilpiHle if* 

needled & ordered 
by physicians 


C. 

Not provided 

under any 
circumstances 


D. 
Don't 

xTViiW W 


11. Tubal Ligation 










12. Inpatient 
Hospital- 
ization 











13. Dermatologists 


- 




- 




14. Allergist^ 










15. ^ Podiatrist 




• 


/ r 




16. Health Care 
^ (domestic) 






' A 


\ 


17. VNA 






. — ; . 


- 


18. Psychiatric 
- fnpatient 










^19. General 
Surgery 










' 20. Health 

Education 










21. Prjescriptions *^ 






"^^r 




22. Ambulance 


V 








23. Transportation 
(other than 
ambulance) 


/ 









/ 
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I. (Cont'd) 



) 



^11. 




B. When you think about enroUee eervic6 request which are not granted, this most often 
happens because: (CHECK ONE BOX ONLY) 

□ • 1. The enroUee hasn't understood whigit.,tl^ Plan in fact provides. . • > • ^ 

□ 2. P.C.U. Staff is not correctly and coif^ipleisly informed as to the range oT services to 

\vhich the enrol lee is entitled. ' ' ' \ , ^ 

□ ^. MHMOFs^Central Offic^ has not explained the provisions to the P.C.U. , 

□ 4. • MHMOFs Central Office has always oversold the enrpUee. 

□ 5. Some instances of each of the above reasons, nooiie in particular. 
Which of the following statements is TRUE? (CHECK ONE OF THE 3 BOX^ 



□ A. The primary **^ontractual relationship is between the P.C.U. and the enroUee 

^assigned to it. ^ 

□ "B. The primary contractual relationship is betv/^en MHMOFs Central Office and the 

enrollee. " . 



□ C. Don't Know. 



I^. By placing the Emergency Care *'HOTLINE" in MHMOFs Central office, the Central Office 
\s: (CHECK ONE OF THE FOLLOWING 3 STATEMENTS) ^ r ^ 

□ A. performing a reasonable, necessary part of patient cfire efficiently. 

'□ B. intruding in patient care under the guise of pcdviding^n efficient service. 

□ XC. No Opinion. . 

B. Considering the paper wprk required of the P.C.U. by Central Office: (CHECK ONE OF THg 
FOLLOWING STATEMENTS) * . 

. . ' '» * 

□ A. All of its seems reasonable and there seems to be a justification for all of it. 

□ B. Some of it seems reasonable and is justified but $ome is not. j , ' 

□ C. Ve^ little seems reasonable/and very little seems justified. 
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A 




A. Please indicate your health center on the line belov/. 
P.C.U. # . 



B. Please mdieateyx)ur functioi^in your heakbcenter by checking the appropriate box. 
^ 1. Patient Care: Physician ' 

□ 2. Patient Care: RN, LPN, Medical Assistant or Aide, Receptionist . 

□ 3. Office: Administrator or Administrative • Assistant, Manager, * Typist/ Clerk, 

Secretary, Billing, Accounting, Bookkeeping. 

n 4. Other: Medical Records, Laboratory or X-ray Technician, Etc. 



. 0 



THANK YOU! 
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APPENDIX 8 — "After" Questionnaire 
ALLIED HEALTH PERSONNEL 

I. A. For each of the iteraa below, check the column which you feel ia approJ)riate. 



Health Service 


A. 

Inclucied in basic 
HMO Package and 

available to 
*' Enrolleea 


B. 

Can be made 
available if 
needed & ordered 
by phyaiciana 


C. 

Not provided 
by HMO contract 
under any 
circumstances " 


Don't 
Know 


1. Prenatal Care 


^ / 


* 






2. Eye Glasses 











3. Plastic 
Surp^tf*rv 
(cosmetic)' 










4. Outpatients 
Stiifiies 




* 






5. EKG & EEG 






r 




6. Abortions 











7. Dental Care 
» 










8. Psychiatric 
Care 

OutpaUent 










9. Contact 
Lens 






\ 


0 


10. Emergency » 
Room 
Services 
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I. A. (Cont^d) 



Health Service 


A. 

Included in basic 
HMO Package and 
available to 
enrollees 


B. 

Can be made 
available if 

Jl -] O Jl Jl 

needed ik ordered 
by physicians 


c. \ 

Not provided 
by HMO contract 
under any 
circumstances 


D. 

Don t 
Know 


: 11: Tubar Ligation 










12. Inpatient 

Hospitalization 










13. Dermatologists 










14. Allergists 






i 




15. Podiatrist 










16. Health Care 
(doniestiC) 












•- 








18. Psych^artric 
Inpatient 


- 








, 19. General 
Surgery 










20. Health 

Education 








\ 


21. Prespiptions 




: 






• 22. Ambulance 






' * . 




23. Transportation 
(other than 
ambulance) 






{ 
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B. When you talk about enroUee servic^^quest which are not granted, this most often 
happen^ because: (CHECK ONE BOX OWLY) 

□ 1. The enroUee hasn't understood what the Plan in fact proves. ^ 

□ 2. PCU Staff is not correctly and completely informed as to the range of services to 
which the enroUee is entitled. • / 

s Central Office has not explained the provisions to the PCU. 

' 

□ 4. MHMOFs Central Office has always oversold the en>©llee. 

□ 5. Some inst^tnces of each of the above reasons, no one in particular. 

II. Which of the following statements i^tRUE? (CHECK ONE OF THE 3 BOXES) 

n AJPhe piiimary contractual relationship is between the PCU and the enrollee assigned to 
it. 

□ ' B. The primary contractual relationship is between MHMOFs Central Office and the 
etiroUee. - ♦ , / 

□ C.D^'t Know. 

III. By placing the Eipergency CaYe "HOTLINE" jn MHMOFs Central Office, the Centrd^ffice 
^ is: (CHECK ONE OF THE FOLLOWING 3 STATEMENTS) ' 

□ A. performing a reasonable necessary part of patient ca(re efficiently. 

^ □ B. intruding in patient care under the guise of providing an efficient service. 

□ C. No Opinion. 

IV: Considering the paper work required of the PCU>y Central Office. (CHECK ONE OF THE 

FOLLOWING STATEMENTS) 
* 

□ A. All of it seems reasonable and there se^ms to be a justification for all of \C 
^ ♦ □ B. Some of it seems reasonable and is justified but some^is not. 

□ . C.Very little seems reasonable ^d very little seems justi^ec^. 
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> A. Please indicate your health center on the line below. *• " « 

B. Please indicate your function in your health center by checlcfng the appropriate box. 
, u 1. Patient Carfe: Physfciari ; ) 

□ 2. Patient Ca|p: RN, LPN, MedicafA^ssistant or Aide, Receptionist 

3. Office: Administrator or Administrative Assistant, Manager, Typist, Clerk, Secretary, 
Billing, Accounting, Bookkeeping 

□ 4. Other: -Medical Records, Laboratory or X-ray Technician, etc. 



THANK YOU! 



ERIC 
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APPENDK 9 

• Q 

TRAINING CONFERENCE PARTICIPANTS 

'> ■ ' ' <?. ■' , 

Ernest Ajluni, D.P.M., Detroit Medical & Surgical Center 
Mary Austin, Family Medical Health Center 
Toni Austin, Detfoit Medical & Surg^eaTCenter 
Barbara Baker, Detroit Medical &/mirgical Center 
Helen Baker, McESpugall Medical/Center 
Heyam Bazzy^ Detroit Medical Associates 
Colette Bell, PsVcho Therapeutics, Inc. 
Arthur W /Baddie, M.D., Detroit Medical & Surgical Cent 
Nancy Bowen, Vincent, Combs & Masse Health Center 
Barbara Brazill, Tri-City Comprehensive Health Cent^ 
Barbara Brooks, Detroit Medical & Surgical Center 

Essie Butler, De'troit Medical Associates 

Joyce Chambers, Detroit Medical & Surgical Center 

Benjamin Clawson, D.D.S. ^ 

Julia Colbert, Psycho Therapeutics, Inc. 

Mary Cole, F^amily Medical Health Centef ^ ' . 

Annette Collins, Vincent, Combs & Masse He^h Center 

Julius Combs, M.D., Vincent, Combs & Masse Health Center 

David^ Conley, Psycho Therapeutics, Inc. 

Norma Jean Coopef , Detroit Medical Associates 

Leona Crittendon, Detroit Medical Associates 

Nancy^Davidson, Tri-City Cortiprehensive Health Center 

Anita Davis, Psycho Therapeutics, Inc. 

William Doss, Jr., M.D., Psycho Therapeutics, Inc. 

George C. Evans, M.D., Detroit Medical & Surgfcal Center 
^William Farnier, M.D., Oakland Internists Associates, P.C. 

Thomas M. Flake, M.D., Detj-oit Medical Associates 

Ernestine Franklin, Tri-City Comprehensive Health Center 

Daryl Freeihan, D.D.S. 

Floorie Guzman, McDougall Medical Center 
Freda Hall, McDougall Medical Center 
Gladys Hardy, Detroit Medical & Surgical Renter 
Harcourt Harris,Ttf.D., Detroit Medical Associates 
Lynne Haugabook, McDougall Medical Center 
Joseph C. Haynes, Psycho Therapeutics, Inc. 
Stella Hector, Detroit Medical Associates 
Cprine Henry, Detroit Medical & Surgical Center 
Kassandra Hill, McDougall Medical Center 
Gloria Hinton, Detroit Medical & Surgical tenter 
Almetta Holland, Vincent, Combs & Masse Health Center 
Franzetta .Houston, Detroit Medical Associates 
Delores Jackson, McDougall Medical Center 
Deborah Jenkins, Detroit Medical & Surgkal Center 
Mary Jennings, Detroit Medical & Surgical Center 
Rudy Johnson, Detroit Medical Associates 
Ruthie Johnson, Detroit Medical & Surgical Center 
Eileen Laston, Detroit Medical & Surgical Center 
Earlene Locust, Detroit Medical & Surgical Center 
Gwen Lovelac^, Detroit Medical Associates 
Marnise Madison, Detroit Medical & Surgical Center 
Brerida Malone, ViYicent, Combs & Masse Health Center 
Carol McArthur Detroit Medical Asso^ates 
Marion McCall, M.D., Ophthalmology 
William McPhail, M.D., Family Medical Health Center ' 
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Vera Miggins, Detroit M^i^l & Surgical Center 

Katheririe Miller, Detroit Medical Apsociates 

S. B. Milton, M.D., Tri-City Comprehensive Health Center 

Oscar C. Mitchell, M.D., Family Medical Health Center 

Joy Mccre, McDougall Medical Center 

Edward Nash, M.D., McDougall Medical Center 

Dorothy Nichols, Detroit Medical Associates 

Evelyn Olive, McDougall Medical Center 

Helen O'Neal, Detroit IVJ^sdical Associates 

Carol Orange, Vincent jpombs & Masse Health Center 

Jocella Page, Vincent, Combs & Masse Health Center 

Mohamel G. A. Patel, M.D., Detroit^Medical & Surgical Center 

Jessie Pickett, Psycho Therapeutics, ihc. 

Richard Pillon, R. Ph., Tri-City Comprehensive Health Center 

Rudolph'A. Porter, M.D., (Deceased), Tri-City Comprehensive Health Center 

Hetra Powell, Vincent, Combs & Masse Health Center 
f Rhonda Price, Detroit Medical' & Surgical Center 
^ Jevyell Reese, Detroit Medical Associates 

Maurice A. Richard, M.D., Detroit Medicaljfe Surgical Center 

Jorge fllloee, M.D., McDougall Medical Center 

Yvonne ^03S, Detroit Medical & Surgical Centei" ' ^ 

Particia Rbjml, Vincent, Combs & Masse Health Center 

Chaman L. Ski;ii>, M.D./ S & S Medical Health Center - 

Elie Sarraf, M.t)^, Detroit Medical & Surgical Center 

Connie Scott, Psycho Therapeutics. Inc. ^ 

Franklin Seabrooks, M.D., Detroit Medical Associates 

Nimrod Sfe^man, M.D., McDougall Medical Center 

Joya Shorter, Psycho Therapeutics, Inc. 

Barbara Simmons, I/etroit Medical Associates 

Ozell Smith, Psycho Therapeutics, Inc. ^ 

Patsy Smifh, Detroit Medkal & Surgical Center 
, Ann Stinson, McDougall Mtedical Center , ^ 

Alma Summers, Vincent, Combs & Masse Health Center 

Lionel F. Swan, M.D., Detroit Medical & Surgical Center 
^ Sylvia Tarplin, Detroit Medical & Surgical Center 

Rosalind Taylor, Detroit Medical & Surgical Center - ^ 

Bettye Thompson, Detroit. Medical & ,Surgical Ceftiter 

Willie Mae Thompson, Detroit Medical Associates 

Giissie Thornton, Detroit Medical & Surgical Center 

Clifford Tinsley, PsJ^cho Therapeutics, Inc. 

Linda Traylor, Detroit Medical Associates 

Ann Truvillion, Detroit Medical & Surgical Center 

Zondra Turner, Detroit Medical & Surgical Center 

Valerie Valentine, McDougall Medical Center 

Robbie VanTurner, Detroit 'Medical Associates 

Bernie Victor, R. Ph. Tri-City Comprehensive Health Center 

Charles C. Vincent, M.D., Vincent, Combs & Masse Health Center 

Philo Watson, Psycho Therapeutics, Inc. ^ 

Myrtle Webb, Detroit Medical Associates 

Jacob E. White, M.D., McDougall MedicSal Center 

Barl^ara Williams, Detroit Medical & Surgical Center 
^ Helen Williams, Psycho Therapeutics, Inc. 

Lillie Williams, Detfoit^Medical & Surgical Center' , 

Norma Williamson, Psycho Therapeutics, Inc. 

Lulu Wilson, Psycho Therapeutics, Inc, - 
' Salathiel Witherspoon, Psycho Therapeutics, Inc. 

Oscar Woodard, Psycho Therapeutics, Inc. 

Barbara Woodson,, Vincent', tJombs & Masse Health JC^nter 

Jene Wright, Detroit, Medical & Surgical Center ' ^ 

Lillie Young Detroit Medical & Surgical Center 
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